Jul 25 09:56:07 user nova-compute[71312]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 25 09:56:09 user nova-compute[71312]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71312) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 25 09:56:09 user nova-compute[71312]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71312) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 25 09:56:09 user nova-compute[71312]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71312) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 25 09:56:09 user nova-compute[71312]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 25 09:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 09:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 09:56:10 user nova-compute[71312]: INFO nova.virt.driver [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 25 09:56:10 user nova-compute[71312]: INFO nova.compute.provider_config [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] Acquiring lock "singleton_lock" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] Acquired lock "singleton_lock" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] Releasing lock "singleton_lock" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] Full set of CONF: {{(pid=71312) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ******************************************************************************** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] Configuration options gathered from: {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ================================================================================ {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] allow_resize_to_same_host      = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] arq_binding_timeout            = 300 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] backdoor_port                  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] backdoor_socket                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] block_device_allocate_retries  = 300 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] block_device_allocate_retries_interval = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cert                           = self.pem {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] compute_monitors               = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] config_dir                     = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] config_drive_format            = iso9660 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] config_source                  = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] console_host                   = user {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] control_exchange               = nova {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cpu_allocation_ratio           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] daemon                         = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] debug                          = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] default_access_ip_network_name = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] default_availability_zone      = nova {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] default_ephemeral_format       = ext4 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] default_schedule_zone          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] disk_allocation_ratio          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] enable_new_services            = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] enabled_ssl_apis               = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] flat_injected                  = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] force_config_drive             = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] force_raw_images               = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] graceful_shutdown_timeout      = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] heal_instance_info_cache_interval = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] host                           = user {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] instance_build_timeout         = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] instance_delete_interval       = 300 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] instance_name_template         = instance-%08x {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] instance_usage_audit           = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] instance_usage_audit_period    = month {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] internal_service_availability_zone = internal {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] key                            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] live_migration_retry_count     = 30 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] log_config_append              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] log_dir                        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] log_file                       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] log_options                    = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] log_rotate_interval            = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] log_rotate_interval_type       = days {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] log_rotation_type              = none {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] long_rpc_timeout               = 1800 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] max_concurrent_builds          = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] max_concurrent_live_migrations = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] max_concurrent_snapshots       = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] max_local_block_devices        = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] max_logfile_count              = 30 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] max_logfile_size_mb            = 200 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] maximum_instance_delete_attempts = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] metadata_listen                = 0.0.0.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] metadata_listen_port           = 8775 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] metadata_workers               = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] migrate_max_retries            = -1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] mkisofs_cmd                    = genisoimage {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] my_ip                          = 10.0.0.210 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] network_allocate_retries       = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] osapi_compute_listen_port      = 8774 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] osapi_compute_unique_server_name_scope =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] osapi_compute_workers          = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] password_length                = 12 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] periodic_enable                = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] periodic_fuzzy_delay           = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] pointer_model                  = ps2mouse {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] preallocate_images             = none {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] publish_errors                 = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] pybasedir                      = /opt/stack/nova {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ram_allocation_ratio           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] rate_limit_burst               = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] rate_limit_except_level        = CRITICAL {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] rate_limit_interval            = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] reboot_timeout                 = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] reclaim_instance_interval      = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] record                         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] reimage_timeout_per_gb         = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] report_interval                = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] rescue_timeout                 = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] reserved_host_cpus             = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] reserved_host_disk_mb          = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] reserved_host_memory_mb        = 512 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] reserved_huge_pages            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] resize_confirm_window          = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] resize_fs_using_block_device   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] resume_guests_state_on_host_boot = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] rpc_response_timeout           = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] run_external_periodic_tasks    = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] running_deleted_instance_action = reap {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] running_deleted_instance_timeout = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] scheduler_instance_sync_interval = 120 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] service_down_time              = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] servicegroup_driver            = db {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] shelved_offload_time           = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] shelved_poll_interval          = 3600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] shutdown_timeout               = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] source_is_ipv6                 = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ssl_only                       = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] state_path                     = /opt/stack/data/nova {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] sync_power_state_interval      = 600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] sync_power_state_pool_size     = 1000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] syslog_log_facility            = LOG_USER {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] tempdir                        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] timeout_nbd                    = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] transport_url                  = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] update_resources_interval      = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] use_cow_images                 = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] use_eventlog                   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] use_journal                    = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] use_json                       = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] use_rootwrap_daemon            = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] use_stderr                     = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] use_syslog                     = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vcpu_pin_set                   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vif_plugging_is_fatal          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vif_plugging_timeout           = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] virt_mkfs                      = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] volume_usage_poll_interval     = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] watch_log_file                 = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] web                            = /usr/share/spice-html5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_concurrency.disable_process_locking = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.auth_strategy              = keystone {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.compute_link_prefix        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.dhcp_domain                = novalocal {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.enable_instance_password   = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.glance_link_prefix         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.instance_list_per_project_cells = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.list_records_by_skipping_down_cells = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.local_metadata_per_cell    = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.max_limit                  = 1000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.metadata_cache_expiration  = 15 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.neutron_default_tenant_id  = default {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.use_forwarded_for          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.use_neutron_default_nets   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.vendordata_dynamic_targets = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.vendordata_jsonfile_path   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.backend_argument         = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.config_prefix            = cache.oslo {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.dead_timeout             = 60.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.debug_cache_backend      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.enable_retry_client      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.enable_socket_keepalive  = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.enabled                  = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.expiration_time          = 600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.hashclient_retry_attempts = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.memcache_dead_retry      = 300 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.memcache_password        =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.memcache_sasl_enabled    = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.memcache_username        =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.proxies                  = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.retry_attempts           = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.retry_delay              = 0.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.socket_keepalive_count   = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.socket_keepalive_idle    = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.socket_keepalive_interval = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.tls_allowed_ciphers      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.tls_cafile               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.tls_certfile             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.tls_enabled              = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cache.tls_keyfile              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.auth_section            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.auth_type               = password {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.cafile                  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.certfile                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.collect_timing          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.cross_az_attach         = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.debug                   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.endpoint_template       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.http_retries            = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.insecure                = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.keyfile                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.os_region_name          = RegionOne {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.split_loggers           = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cinder.timeout                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] compute.cpu_dedicated_set      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] compute.cpu_shared_set         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] compute.image_type_exclude_list = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] compute.resource_provider_association_refresh = 300 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] compute.shutdown_retry_interval = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] conductor.workers              = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] console.allowed_origins        = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] console.ssl_ciphers            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] console.ssl_minimum_version    = default {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] consoleauth.token_ttl          = 600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.cafile                  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.certfile                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.collect_timing          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.connect_retries         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.connect_retry_delay     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.endpoint_override       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.insecure                = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.keyfile                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.max_version             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.min_version             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.region_name             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.service_name            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.service_type            = accelerator {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.split_loggers           = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.status_code_retries     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.status_code_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.timeout                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] cyborg.version                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.backend               = sqlalchemy {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.connection            = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.connection_debug      = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.connection_parameters =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.connection_recycle_time = 3600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.connection_trace      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.db_inc_retry_interval = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.db_max_retries        = 20 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.db_max_retry_interval = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.db_retry_interval     = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.max_overflow          = 50 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.max_pool_size         = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.max_retries           = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.mysql_enable_ndb      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.mysql_wsrep_sync_wait = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.pool_timeout          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.retry_interval        = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.slave_connection      = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] database.sqlite_synchronous    = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.backend           = sqlalchemy {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.connection        = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.connection_debug  = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.connection_parameters =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.connection_recycle_time = 3600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.connection_trace  = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.db_inc_retry_interval = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.db_max_retries    = 20 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.db_max_retry_interval = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.db_retry_interval = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.max_overflow      = 50 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.max_pool_size     = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.max_retries       = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.mysql_enable_ndb  = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.pool_timeout      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.retry_interval    = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.slave_connection  = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] api_database.sqlite_synchronous = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] devices.enabled_mdev_types     = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ephemeral_storage_encryption.enabled = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.api_servers             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.cafile                  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.certfile                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.collect_timing          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.connect_retries         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.connect_retry_delay     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.debug                   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.default_trusted_certificate_ids = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.enable_certificate_validation = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.enable_rbd_download     = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.endpoint_override       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.insecure                = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.keyfile                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.max_version             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.min_version             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.num_retries             = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.rbd_ceph_conf           =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.rbd_connect_timeout     = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.rbd_pool                =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.rbd_user                =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.region_name             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.service_name            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.service_type            = image {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.split_loggers           = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.status_code_retries     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.status_code_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.timeout                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.verify_glance_signatures = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] glance.version                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] guestfs.debug                  = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.config_drive_cdrom      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.config_drive_inject_password = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.enable_remotefx         = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.instances_path_share    =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.limit_cpu_features      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.use_multipath_io        = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.vswitch_name            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] mks.enabled                    = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] image_cache.manager_interval   = 2400 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] image_cache.precache_concurrency = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] image_cache.remove_unused_base_images = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] image_cache.subdirectory_name  = _base {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.api_max_retries         = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.api_retry_interval      = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.auth_section            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.auth_type               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.cafile                  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.certfile                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.collect_timing          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.connect_retries         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.connect_retry_delay     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.endpoint_override       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.insecure                = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.keyfile                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.max_version             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.min_version             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.partition_key           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.peer_list               = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.region_name             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.serial_console_state_timeout = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.service_name            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.service_type            = baremetal {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.split_loggers           = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.status_code_retries     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.status_code_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.timeout                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ironic.version                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] key_manager.fixed_key          = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.barbican_api_version  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.barbican_endpoint     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.barbican_endpoint_type = public {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.barbican_region_name  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.cafile                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.certfile              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.collect_timing        = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.insecure              = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.keyfile               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.number_of_retries     = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.retry_delay           = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.send_service_user_token = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.split_loggers         = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.timeout               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.verify_ssl            = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican.verify_ssl_path       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican_service_user.auth_section = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican_service_user.auth_type = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican_service_user.cafile   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican_service_user.certfile = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican_service_user.collect_timing = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican_service_user.insecure = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican_service_user.keyfile  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican_service_user.split_loggers = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] barbican_service_user.timeout  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.approle_role_id          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.approle_secret_id        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.cafile                   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.certfile                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.collect_timing           = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.insecure                 = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.keyfile                  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.kv_mountpoint            = secret {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.kv_version               = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.namespace                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.root_token_id            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.split_loggers            = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.ssl_ca_crt_file          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.timeout                  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.use_ssl                  = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.cafile                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.certfile              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.collect_timing        = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.connect_retries       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.connect_retry_delay   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.endpoint_override     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.insecure              = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.keyfile               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.max_version           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.min_version           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.region_name           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.service_name          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.service_type          = identity {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.split_loggers         = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.status_code_retries   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.status_code_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.timeout               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] keystone.version               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.connection_uri         =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.cpu_mode               = custom {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: WARNING oslo_config.cfg [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.cpu_power_governor_high = performance {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.cpu_power_management   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.device_detach_attempts = 8 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.device_detach_timeout  = 20 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.disk_cachemodes        = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.disk_prefix            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.enabled_perf_events    = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.file_backed_memory     = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.gid_maps               = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.hw_disk_discard        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.hw_machine_type        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.images_rbd_pool        = rbd {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.images_type            = default {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.images_volume_group    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.inject_key             = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.inject_partition       = -2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.inject_password        = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.iscsi_iface            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.iser_use_multipath     = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.live_migration_downtime = 500 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.live_migration_inbound_addr = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.live_migration_scheme  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.live_migration_timeout_action = abort {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.live_migration_tunnelled = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: WARNING oslo_config.cfg [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 25 09:56:10 user nova-compute[71312]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 25 09:56:10 user nova-compute[71312]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 25 09:56:10 user nova-compute[71312]: and ``live_migration_inbound_addr`` respectively.
Jul 25 09:56:10 user nova-compute[71312]: ).  Its value may be silently ignored in the future.
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.live_migration_with_native_tls = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.max_queues             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.nfs_mount_options      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.num_pcie_ports         = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.pmem_namespaces        = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.quobyte_client_cfg     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.rbd_secret_uuid        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.rbd_user               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.rescue_image_id        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.rescue_kernel_id       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.rx_queue_size          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.smbfs_mount_options    =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.snapshot_compression   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.snapshot_image_format  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.sparse_logical_volumes = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.swtpm_enabled          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.swtpm_group            = tss {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.swtpm_user             = tss {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.sysinfo_serial         = unique {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.tb_cache_size          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.tx_queue_size          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.uid_maps               = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.use_virtio_for_bridges = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.virt_type              = kvm {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.volume_clear           = zero {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.volume_clear_size      = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.volume_use_multipath   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.vzstorage_cache_path   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.auth_section           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.auth_type              = password {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.cafile                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.certfile               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.collect_timing         = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.connect_retries        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.connect_retry_delay    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.default_floating_pool  = public {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.endpoint_override      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.extension_sync_interval = 600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.http_retries           = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.insecure               = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.keyfile                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.max_version            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.min_version            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.ovs_bridge             = br-int {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.physnets               = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.region_name            = RegionOne {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.service_metadata_proxy = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.service_name           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.service_type           = network {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.split_loggers          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.status_code_retries    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.status_code_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.timeout                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] neutron.version                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] notifications.bdms_in_notifications = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] notifications.default_level    = INFO {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] notifications.notification_format = unversioned {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] notifications.notify_on_state_change = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] pci.alias                      = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] pci.device_spec                = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] pci.report_in_placement        = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.auth_section         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.auth_type            = password {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.cafile               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.certfile             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.collect_timing       = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.connect_retries      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.connect_retry_delay  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.default_domain_id    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.default_domain_name  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.domain_id            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.domain_name          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.endpoint_override    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.insecure             = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.keyfile              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.max_version          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.min_version          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.password             = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.project_domain_id    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.project_domain_name  = Default {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.project_id           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.project_name         = service {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.region_name          = RegionOne {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.service_name         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.service_type         = placement {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.split_loggers        = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.status_code_retries  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.status_code_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.system_scope         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.timeout              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.trust_id             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.user_domain_id       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.user_domain_name     = Default {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.user_id              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.username             = placement {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] placement.version              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] quota.cores                    = 20 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] quota.count_usage_from_placement = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] quota.injected_file_content_bytes = 10240 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] quota.injected_file_path_length = 255 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] quota.injected_files           = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] quota.instances                = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] quota.key_pairs                = 100 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] quota.metadata_items           = 128 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] quota.ram                      = 51200 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] quota.recheck_quota            = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] quota.server_group_members     = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] quota.server_groups            = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] rdp.enabled                    = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] scheduler.image_metadata_prefilter = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] scheduler.max_attempts         = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] scheduler.max_placement_results = 1000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] scheduler.workers              = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.host_subset_size = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.isolated_hosts = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.isolated_images = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.pci_in_placement = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.track_instance_changes = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] metrics.required               = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] metrics.weight_multiplier      = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] metrics.weight_setting         = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] serial_console.enabled         = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] serial_console.port_range      = 10000:20000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] serial_console.serialproxy_port = 6083 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] service_user.auth_section      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] service_user.auth_type         = password {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] service_user.cafile            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] service_user.certfile          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] service_user.collect_timing    = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] service_user.insecure          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] service_user.keyfile           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] service_user.send_service_user_token = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] service_user.split_loggers     = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] service_user.timeout           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] spice.agent_enabled            = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] spice.enabled                  = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] spice.html5proxy_port          = 6082 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] spice.image_compression        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] spice.jpeg_compression         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] spice.playback_compression     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] spice.server_listen            = 127.0.0.1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] spice.streaming_mode           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] spice.zlib_compression         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] upgrade_levels.baseapi         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] upgrade_levels.cert            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] upgrade_levels.compute         = auto {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] upgrade_levels.conductor       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] upgrade_levels.scheduler       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vendordata_dynamic_auth.cafile = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vendordata_dynamic_auth.certfile = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vendordata_dynamic_auth.insecure = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vendordata_dynamic_auth.timeout = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.api_retry_count         = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.ca_file                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.cache_prefix            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.cluster_name            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.connection_pool_size    = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.console_delay_seconds   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.datastore_regex         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.host_ip                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.host_password           = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.host_port               = 443 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.host_username           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.insecure                = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.integration_bridge      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.maximum_objects         = 100 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.pbm_default_policy      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.pbm_enabled             = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.pbm_wsdl_location       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.serial_port_proxy_uri   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.serial_port_service_uri = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.task_poll_interval      = 0.5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.use_linked_clone        = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.vnc_keymap              = en-us {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.vnc_port                = 5900 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vmware.vnc_port_total          = 10000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vnc.auth_schemes               = ['none'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vnc.enabled                    = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vnc.novncproxy_port            = 6080 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vnc.vencrypt_ca_certs          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vnc.vencrypt_client_cert       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vnc.vencrypt_client_key        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.disable_rootwrap   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.enable_numa_live_migration = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.libvirt_disable_apic = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] wsgi.client_socket_timeout     = 900 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] wsgi.default_pool_size         = 1000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] wsgi.keep_alive                = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] wsgi.max_header_line           = 16384 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] wsgi.ssl_ca_file               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] wsgi.ssl_cert_file             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] wsgi.ssl_key_file              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] wsgi.tcp_keepidle              = 600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] zvm.ca_file                    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] zvm.cloud_connector_url        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] zvm.reachable_timeout          = 300 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_policy.enforce_new_defaults = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_policy.enforce_scope      = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_policy.policy_default_rule = default {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] profiler.connection_string     = messaging:// {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] profiler.enabled               = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] profiler.es_doc_type           = notification {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] profiler.es_scroll_size        = 10000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] profiler.es_scroll_time        = 2m {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] profiler.filter_error_trace    = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] profiler.hmac_keys             = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] profiler.sentinel_service_name = mymaster {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] profiler.socket_timeout        = 0.1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] profiler.trace_requests        = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] profiler.trace_sqlalchemy      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] profiler_jaeger.process_tags   = {} {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] profiler_jaeger.service_name_prefix = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] profiler_otlp.service_name_prefix = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] remote_debug.host              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] remote_debug.port              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_notifications.retry = -1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.auth_section        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.auth_type           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.cafile              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.certfile            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.collect_timing      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.connect_retries     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.connect_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.endpoint_id         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.endpoint_override   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.insecure            = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.keyfile             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.max_version         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.min_version         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.region_name         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.service_name        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.service_type        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.split_loggers       = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.status_code_retries = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.status_code_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.timeout             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.valid_interfaces    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_limit.version             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_reports.file_event_handler = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] oslo_reports.log_dir           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vif_plug_ovs_privileged.group  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] vif_plug_ovs_privileged.user   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_vif_ovs.isolate_vif         = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] os_brick.lock_path             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] privsep_osbrick.capabilities   = [21] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] privsep_osbrick.group          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] privsep_osbrick.helper_command = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] privsep_osbrick.user           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] nova_sys_admin.group           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] nova_sys_admin.helper_command  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] nova_sys_admin.user            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG oslo_service.service [None req-70df6645-d0c8-4432-ba8f-7fa8e6f89fb8 None None] ******************************************************************************** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 25 09:56:10 user nova-compute[71312]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 25 09:56:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Starting native event thread {{(pid=71312) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Starting green dispatch thread {{(pid=71312) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Starting connection event dispatch thread {{(pid=71312) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Connecting to libvirt: qemu:///system {{(pid=71312) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fa9cadd34f0> {{(pid=71312) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 25 09:56:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fa9cadd34f0> {{(pid=71312) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 25 09:56:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Connection event '1' reason 'None'
Jul 25 09:56:10 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 25 09:56:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.mount [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Initialising _HostMountState generation 0 {{(pid=71312) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 25 09:56:17 user nova-compute[71312]: INFO nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Libvirt host capabilities <capabilities>
Jul 25 09:56:17 user nova-compute[71312]:   <host>
Jul 25 09:56:17 user nova-compute[71312]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 25 09:56:17 user nova-compute[71312]:     <cpu>
Jul 25 09:56:17 user nova-compute[71312]:       <arch>x86_64</arch>
Jul 25 09:56:17 user nova-compute[71312]:       <model>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <vendor>Intel</vendor>
Jul 25 09:56:17 user nova-compute[71312]:       <microcode version='1070'/>
Jul 25 09:56:17 user nova-compute[71312]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 25 09:56:17 user nova-compute[71312]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature name='ss'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature name='vmx'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature name='pcid'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature name='osxsave'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature name='hypervisor'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature name='arat'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature name='tsc_adjust'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature name='md-clear'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature name='stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature name='arch-capabilities'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature name='ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature name='invtsc'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature name='rsba'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature name='skip-l1dfl-vmentry'/>
Jul 25 09:56:17 user nova-compute[71312]:       <pages unit='KiB' size='4'/>
Jul 25 09:56:17 user nova-compute[71312]:       <pages unit='KiB' size='2048'/>
Jul 25 09:56:17 user nova-compute[71312]:     </cpu>
Jul 25 09:56:17 user nova-compute[71312]:     <power_management>
Jul 25 09:56:17 user nova-compute[71312]:       <suspend_mem/>
Jul 25 09:56:17 user nova-compute[71312]:       <suspend_disk/>
Jul 25 09:56:17 user nova-compute[71312]:       <suspend_hybrid/>
Jul 25 09:56:17 user nova-compute[71312]:     </power_management>
Jul 25 09:56:17 user nova-compute[71312]:     <iommu support='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     <migration_features>
Jul 25 09:56:17 user nova-compute[71312]:       <live/>
Jul 25 09:56:17 user nova-compute[71312]:       <uri_transports>
Jul 25 09:56:17 user nova-compute[71312]:         <uri_transport>tcp</uri_transport>
Jul 25 09:56:17 user nova-compute[71312]:         <uri_transport>rdma</uri_transport>
Jul 25 09:56:17 user nova-compute[71312]:       </uri_transports>
Jul 25 09:56:17 user nova-compute[71312]:     </migration_features>
Jul 25 09:56:17 user nova-compute[71312]:     <topology>
Jul 25 09:56:17 user nova-compute[71312]:       <cells num='2'>
Jul 25 09:56:17 user nova-compute[71312]:         <cell id='0'>
Jul 25 09:56:17 user nova-compute[71312]:           <memory unit='KiB'>8189224</memory>
Jul 25 09:56:17 user nova-compute[71312]:           <pages unit='KiB' size='4'>2047306</pages>
Jul 25 09:56:17 user nova-compute[71312]:           <pages unit='KiB' size='2048'>0</pages>
Jul 25 09:56:17 user nova-compute[71312]:           <distances>
Jul 25 09:56:17 user nova-compute[71312]:             <sibling id='0' value='10'/>
Jul 25 09:56:17 user nova-compute[71312]:             <sibling id='1' value='20'/>
Jul 25 09:56:17 user nova-compute[71312]:           </distances>
Jul 25 09:56:17 user nova-compute[71312]:           <cpus num='6'>
Jul 25 09:56:17 user nova-compute[71312]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 25 09:56:17 user nova-compute[71312]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 25 09:56:17 user nova-compute[71312]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 25 09:56:17 user nova-compute[71312]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 25 09:56:17 user nova-compute[71312]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 25 09:56:17 user nova-compute[71312]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 25 09:56:17 user nova-compute[71312]:           </cpus>
Jul 25 09:56:17 user nova-compute[71312]:         </cell>
Jul 25 09:56:17 user nova-compute[71312]:         <cell id='1'>
Jul 25 09:56:17 user nova-compute[71312]:           <memory unit='KiB'>8206460</memory>
Jul 25 09:56:17 user nova-compute[71312]:           <pages unit='KiB' size='4'>2051615</pages>
Jul 25 09:56:17 user nova-compute[71312]:           <pages unit='KiB' size='2048'>0</pages>
Jul 25 09:56:17 user nova-compute[71312]:           <distances>
Jul 25 09:56:17 user nova-compute[71312]:             <sibling id='0' value='20'/>
Jul 25 09:56:17 user nova-compute[71312]:             <sibling id='1' value='10'/>
Jul 25 09:56:17 user nova-compute[71312]:           </distances>
Jul 25 09:56:17 user nova-compute[71312]:           <cpus num='6'>
Jul 25 09:56:17 user nova-compute[71312]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 25 09:56:17 user nova-compute[71312]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 25 09:56:17 user nova-compute[71312]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 25 09:56:17 user nova-compute[71312]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 25 09:56:17 user nova-compute[71312]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 25 09:56:17 user nova-compute[71312]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 25 09:56:17 user nova-compute[71312]:           </cpus>
Jul 25 09:56:17 user nova-compute[71312]:         </cell>
Jul 25 09:56:17 user nova-compute[71312]:       </cells>
Jul 25 09:56:17 user nova-compute[71312]:     </topology>
Jul 25 09:56:17 user nova-compute[71312]:     <cache>
Jul 25 09:56:17 user nova-compute[71312]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 25 09:56:17 user nova-compute[71312]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 25 09:56:17 user nova-compute[71312]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 25 09:56:17 user nova-compute[71312]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 25 09:56:17 user nova-compute[71312]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 25 09:56:17 user nova-compute[71312]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 25 09:56:17 user nova-compute[71312]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 25 09:56:17 user nova-compute[71312]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 25 09:56:17 user nova-compute[71312]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 25 09:56:17 user nova-compute[71312]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 25 09:56:17 user nova-compute[71312]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 25 09:56:17 user nova-compute[71312]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 25 09:56:17 user nova-compute[71312]:     </cache>
Jul 25 09:56:17 user nova-compute[71312]:     <secmodel>
Jul 25 09:56:17 user nova-compute[71312]:       <model>apparmor</model>
Jul 25 09:56:17 user nova-compute[71312]:       <doi>0</doi>
Jul 25 09:56:17 user nova-compute[71312]:     </secmodel>
Jul 25 09:56:17 user nova-compute[71312]:     <secmodel>
Jul 25 09:56:17 user nova-compute[71312]:       <model>dac</model>
Jul 25 09:56:17 user nova-compute[71312]:       <doi>0</doi>
Jul 25 09:56:17 user nova-compute[71312]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 25 09:56:17 user nova-compute[71312]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 25 09:56:17 user nova-compute[71312]:     </secmodel>
Jul 25 09:56:17 user nova-compute[71312]:   </host>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='alpha'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>64</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>clipper</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='armv6l'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>integratorcp</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>borzoi</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>spitz</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>nuri</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>musca-b1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>versatileab</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>kzm</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>musca-a</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>smdkc210</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sx1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>z2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>tosa</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>sabrelite</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>realview-eb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>n810</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>n800</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>versatilepb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>terrier</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mainstone</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>midway</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>musicpal</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>microbit</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>cubieboard</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>verdex</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>netduino2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>raspi2b</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>cheetah</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>highbank</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>akita</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>connex</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>collie</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>raspi0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='armv7l'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>integratorcp</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>borzoi</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>spitz</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>nuri</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>musca-b1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>versatileab</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>kzm</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>musca-a</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>smdkc210</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sx1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>z2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>tosa</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>sabrelite</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>realview-eb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>n810</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>n800</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>versatilepb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>terrier</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mainstone</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>midway</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>musicpal</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>microbit</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>cubieboard</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>verdex</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>netduino2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>raspi2b</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>cheetah</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>highbank</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>akita</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>connex</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>collie</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>raspi0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='aarch64'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>64</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>integratorcp</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>borzoi</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>spitz</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>nuri</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>musca-b1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>versatileab</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>kzm</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>musca-a</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>smdkc210</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sx1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>z2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>tosa</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>sabrelite</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>realview-eb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>n810</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>n800</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>versatilepb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>terrier</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mainstone</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>midway</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>musicpal</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>microbit</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>cubieboard</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>verdex</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>netduino2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>raspi3b</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>raspi2b</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>cheetah</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>highbank</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>akita</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>connex</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>collie</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>raspi0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <acpi default='on' toggle='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='cris'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='i686'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>x-remote</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>isapc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>microvm</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='kvm'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <pae/>
Jul 25 09:56:17 user nova-compute[71312]:       <nonpae/>
Jul 25 09:56:17 user nova-compute[71312]:       <acpi default='on' toggle='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:       <apic default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='m68k'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>an5206</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>q800</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>next-cube</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='microblaze'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='microblazeel'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='mips'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='16'>malta</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mipssim</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='mipsel'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='16'>malta</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mipssim</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='mips64'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>64</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='16'>malta</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mipssim</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>pica61</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>magnum</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='mips64el'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>64</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='16'>malta</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mipssim</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>pica61</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>magnum</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='16'>boston</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='ppc'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>g3beige</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mac99</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>ppce500</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>pegasos2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sam460ex</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>bamboo</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>40p</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>ref405ep</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>taihu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='ppc64'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>64</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2048'>powernv9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>taihu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2048'>powernv10</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>ppce500</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>40p</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>pegasos2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>bamboo</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>g3beige</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mac99</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sam460ex</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>ref405ep</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2048'>powernv8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='ppc64le'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>64</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2048'>powernv9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>taihu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2048'>powernv10</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>ppce500</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>40p</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>pegasos2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>bamboo</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>g3beige</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>mac99</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sam460ex</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>ref405ep</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2048'>powernv8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='riscv32'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='8'>spike</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>opentitan</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='5'>sifive_u</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sifive_e</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='8'>virt</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='riscv64'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>64</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='8'>spike</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='5'>sifive_u</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>shakti_c</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sifive_e</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='8'>virt</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='s390x'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>64</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='sh4'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>shix</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>r2d</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='sh4eb'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>64</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>shix</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>r2d</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='sparc'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>SS-5</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>SS-20</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>LX</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>SS-4</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>SS-10</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>Voyager</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='sparc64'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>64</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sun4u</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>niagara</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>sun4v</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='x86_64'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>64</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>x-remote</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='1'>isapc</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>microvm</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='kvm'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <acpi default='on' toggle='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:       <apic default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='xtensa'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>sim</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>kc705</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>ml605</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>virt</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>lx200</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>lx60</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]:   <guest>
Jul 25 09:56:17 user nova-compute[71312]:     <os_type>hvm</os_type>
Jul 25 09:56:17 user nova-compute[71312]:     <arch name='xtensaeb'>
Jul 25 09:56:17 user nova-compute[71312]:       <wordsize>32</wordsize>
Jul 25 09:56:17 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='4'>sim</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>kc705</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>ml605</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>virt</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>lx200</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>lx60</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 25 09:56:17 user nova-compute[71312]:       <domain type='qemu'/>
Jul 25 09:56:17 user nova-compute[71312]:     </arch>
Jul 25 09:56:17 user nova-compute[71312]:     <features>
Jul 25 09:56:17 user nova-compute[71312]:       <cpuselection/>
Jul 25 09:56:17 user nova-compute[71312]:       <deviceboot/>
Jul 25 09:56:17 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     </features>
Jul 25 09:56:17 user nova-compute[71312]:   </guest>
Jul 25 09:56:17 user nova-compute[71312]: </capabilities>
Jul 25 09:56:17 user nova-compute[71312]: 
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 25 09:56:17 user nova-compute[71312]: <domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:   <path>/usr/bin/qemu-system-i386</path>
Jul 25 09:56:17 user nova-compute[71312]:   <domain>kvm</domain>
Jul 25 09:56:17 user nova-compute[71312]:   <machine>pc-q35-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:   <arch>i686</arch>
Jul 25 09:56:17 user nova-compute[71312]:   <vcpu max='288'/>
Jul 25 09:56:17 user nova-compute[71312]:   <iothreads supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:   <os supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='firmware'/>
Jul 25 09:56:17 user nova-compute[71312]:     <loader supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>rom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pflash</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='readonly'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>yes</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='secure'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </loader>
Jul 25 09:56:17 user nova-compute[71312]:   </os>
Jul 25 09:56:17 user nova-compute[71312]:   <cpu>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='maximumMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>on</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <vendor>Intel</vendor>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='lm'/>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>phenom</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>n270</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>kvm64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>core2duo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>athlon</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Westmere-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Westmere</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Penryn</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G1</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Nehalem-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Nehalem</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Conroe</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>486</model>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:   </cpu>
Jul 25 09:56:17 user nova-compute[71312]:   <memoryBacking supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='sourceType'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>file</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>anonymous</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>memfd</value>
Jul 25 09:56:17 user nova-compute[71312]:     </enum>
Jul 25 09:56:17 user nova-compute[71312]:   </memoryBacking>
Jul 25 09:56:17 user nova-compute[71312]:   <devices>
Jul 25 09:56:17 user nova-compute[71312]:     <disk supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='diskDevice'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>disk</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cdrom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>floppy</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>lun</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='bus'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>fdc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sata</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </disk>
Jul 25 09:56:17 user nova-compute[71312]:     <graphics supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sdl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vnc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>spice</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egl-headless</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </graphics>
Jul 25 09:56:17 user nova-compute[71312]:     <video supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='modelType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cirrus</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vmvga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>qxl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>none</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>bochs</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>ramfb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </video>
Jul 25 09:56:17 user nova-compute[71312]:     <hostdev supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='mode'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>subsystem</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='startupPolicy'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>default</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>mandatory</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>requisite</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>optional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='subsysType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pci</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='capsType'/>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='pciBackend'/>
Jul 25 09:56:17 user nova-compute[71312]:     </hostdev>
Jul 25 09:56:17 user nova-compute[71312]:     <rng supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>random</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egd</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>builtin</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </rng>
Jul 25 09:56:17 user nova-compute[71312]:     <filesystem supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='driverType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>path</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>handle</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtiofs</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </filesystem>
Jul 25 09:56:17 user nova-compute[71312]:     <tpm supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-tis</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-crb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>passthrough</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>emulator</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </tpm>
Jul 25 09:56:17 user nova-compute[71312]:   </devices>
Jul 25 09:56:17 user nova-compute[71312]:   <features>
Jul 25 09:56:17 user nova-compute[71312]:     <gic supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <genid supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backup supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <sev supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:   </features>
Jul 25 09:56:17 user nova-compute[71312]: </domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 25 09:56:17 user nova-compute[71312]: <domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:   <path>/usr/bin/qemu-system-i386</path>
Jul 25 09:56:17 user nova-compute[71312]:   <domain>kvm</domain>
Jul 25 09:56:17 user nova-compute[71312]:   <machine>pc-q35-jammy</machine>
Jul 25 09:56:17 user nova-compute[71312]:   <arch>i686</arch>
Jul 25 09:56:17 user nova-compute[71312]:   <vcpu max='288'/>
Jul 25 09:56:17 user nova-compute[71312]:   <iothreads supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:   <os supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='firmware'/>
Jul 25 09:56:17 user nova-compute[71312]:     <loader supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>rom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pflash</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='readonly'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>yes</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='secure'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </loader>
Jul 25 09:56:17 user nova-compute[71312]:   </os>
Jul 25 09:56:17 user nova-compute[71312]:   <cpu>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='maximumMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>on</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <vendor>Intel</vendor>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='lm'/>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>phenom</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>n270</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>kvm64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>core2duo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>athlon</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Westmere-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Westmere</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Penryn</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G1</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Nehalem-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Nehalem</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Conroe</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>486</model>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:   </cpu>
Jul 25 09:56:17 user nova-compute[71312]:   <memoryBacking supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='sourceType'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>file</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>anonymous</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>memfd</value>
Jul 25 09:56:17 user nova-compute[71312]:     </enum>
Jul 25 09:56:17 user nova-compute[71312]:   </memoryBacking>
Jul 25 09:56:17 user nova-compute[71312]:   <devices>
Jul 25 09:56:17 user nova-compute[71312]:     <disk supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='diskDevice'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>disk</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cdrom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>floppy</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>lun</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='bus'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>fdc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sata</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </disk>
Jul 25 09:56:17 user nova-compute[71312]:     <graphics supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sdl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vnc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>spice</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egl-headless</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </graphics>
Jul 25 09:56:17 user nova-compute[71312]:     <video supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='modelType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cirrus</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vmvga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>qxl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>none</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>bochs</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>ramfb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </video>
Jul 25 09:56:17 user nova-compute[71312]:     <hostdev supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='mode'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>subsystem</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='startupPolicy'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>default</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>mandatory</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>requisite</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>optional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='subsysType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pci</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='capsType'/>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='pciBackend'/>
Jul 25 09:56:17 user nova-compute[71312]:     </hostdev>
Jul 25 09:56:17 user nova-compute[71312]:     <rng supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>random</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egd</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>builtin</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </rng>
Jul 25 09:56:17 user nova-compute[71312]:     <filesystem supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='driverType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>path</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>handle</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtiofs</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </filesystem>
Jul 25 09:56:17 user nova-compute[71312]:     <tpm supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-tis</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-crb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>passthrough</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>emulator</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </tpm>
Jul 25 09:56:17 user nova-compute[71312]:   </devices>
Jul 25 09:56:17 user nova-compute[71312]:   <features>
Jul 25 09:56:17 user nova-compute[71312]:     <gic supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <genid supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backup supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <sev supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:   </features>
Jul 25 09:56:17 user nova-compute[71312]: </domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 25 09:56:17 user nova-compute[71312]: <domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:   <path>/usr/bin/qemu-system-i386</path>
Jul 25 09:56:17 user nova-compute[71312]:   <domain>kvm</domain>
Jul 25 09:56:17 user nova-compute[71312]:   <machine>pc-i440fx-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:   <arch>i686</arch>
Jul 25 09:56:17 user nova-compute[71312]:   <vcpu max='255'/>
Jul 25 09:56:17 user nova-compute[71312]:   <iothreads supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:   <os supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='firmware'/>
Jul 25 09:56:17 user nova-compute[71312]:     <loader supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>rom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pflash</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='readonly'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>yes</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='secure'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </loader>
Jul 25 09:56:17 user nova-compute[71312]:   </os>
Jul 25 09:56:17 user nova-compute[71312]:   <cpu>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='maximumMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>on</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <vendor>Intel</vendor>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='lm'/>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>phenom</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>n270</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>kvm64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>core2duo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>athlon</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Westmere-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Westmere</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Penryn</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G1</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Nehalem-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Nehalem</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Conroe</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>486</model>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:   </cpu>
Jul 25 09:56:17 user nova-compute[71312]:   <memoryBacking supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='sourceType'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>file</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>anonymous</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>memfd</value>
Jul 25 09:56:17 user nova-compute[71312]:     </enum>
Jul 25 09:56:17 user nova-compute[71312]:   </memoryBacking>
Jul 25 09:56:17 user nova-compute[71312]:   <devices>
Jul 25 09:56:17 user nova-compute[71312]:     <disk supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='diskDevice'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>disk</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cdrom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>floppy</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>lun</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='bus'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>ide</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>fdc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sata</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </disk>
Jul 25 09:56:17 user nova-compute[71312]:     <graphics supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sdl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vnc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>spice</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egl-headless</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </graphics>
Jul 25 09:56:17 user nova-compute[71312]:     <video supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='modelType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cirrus</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vmvga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>qxl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>none</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>bochs</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>ramfb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </video>
Jul 25 09:56:17 user nova-compute[71312]:     <hostdev supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='mode'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>subsystem</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='startupPolicy'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>default</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>mandatory</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>requisite</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>optional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='subsysType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pci</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='capsType'/>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='pciBackend'/>
Jul 25 09:56:17 user nova-compute[71312]:     </hostdev>
Jul 25 09:56:17 user nova-compute[71312]:     <rng supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>random</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egd</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>builtin</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </rng>
Jul 25 09:56:17 user nova-compute[71312]:     <filesystem supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='driverType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>path</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>handle</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtiofs</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </filesystem>
Jul 25 09:56:17 user nova-compute[71312]:     <tpm supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-tis</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-crb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>passthrough</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>emulator</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </tpm>
Jul 25 09:56:17 user nova-compute[71312]:   </devices>
Jul 25 09:56:17 user nova-compute[71312]:   <features>
Jul 25 09:56:17 user nova-compute[71312]:     <gic supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <genid supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backup supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <sev supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:   </features>
Jul 25 09:56:17 user nova-compute[71312]: </domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 25 09:56:17 user nova-compute[71312]: <domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:   <path>/usr/bin/qemu-system-i386</path>
Jul 25 09:56:17 user nova-compute[71312]:   <domain>kvm</domain>
Jul 25 09:56:17 user nova-compute[71312]:   <machine>pc-i440fx-jammy</machine>
Jul 25 09:56:17 user nova-compute[71312]:   <arch>i686</arch>
Jul 25 09:56:17 user nova-compute[71312]:   <vcpu max='255'/>
Jul 25 09:56:17 user nova-compute[71312]:   <iothreads supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:   <os supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='firmware'/>
Jul 25 09:56:17 user nova-compute[71312]:     <loader supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>rom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pflash</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='readonly'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>yes</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='secure'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </loader>
Jul 25 09:56:17 user nova-compute[71312]:   </os>
Jul 25 09:56:17 user nova-compute[71312]:   <cpu>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='maximumMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>on</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <vendor>Intel</vendor>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='lm'/>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>phenom</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>n270</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>kvm64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>core2duo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>athlon</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Westmere-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Westmere</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Penryn</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G1</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Nehalem-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Nehalem</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Conroe</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>486</model>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:   </cpu>
Jul 25 09:56:17 user nova-compute[71312]:   <memoryBacking supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='sourceType'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>file</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>anonymous</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>memfd</value>
Jul 25 09:56:17 user nova-compute[71312]:     </enum>
Jul 25 09:56:17 user nova-compute[71312]:   </memoryBacking>
Jul 25 09:56:17 user nova-compute[71312]:   <devices>
Jul 25 09:56:17 user nova-compute[71312]:     <disk supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='diskDevice'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>disk</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cdrom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>floppy</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>lun</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='bus'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>ide</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>fdc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sata</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </disk>
Jul 25 09:56:17 user nova-compute[71312]:     <graphics supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sdl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vnc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>spice</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egl-headless</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </graphics>
Jul 25 09:56:17 user nova-compute[71312]:     <video supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='modelType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cirrus</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vmvga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>qxl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>none</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>bochs</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>ramfb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </video>
Jul 25 09:56:17 user nova-compute[71312]:     <hostdev supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='mode'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>subsystem</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='startupPolicy'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>default</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>mandatory</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>requisite</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>optional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='subsysType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pci</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='capsType'/>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='pciBackend'/>
Jul 25 09:56:17 user nova-compute[71312]:     </hostdev>
Jul 25 09:56:17 user nova-compute[71312]:     <rng supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>random</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egd</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>builtin</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </rng>
Jul 25 09:56:17 user nova-compute[71312]:     <filesystem supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='driverType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>path</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>handle</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtiofs</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </filesystem>
Jul 25 09:56:17 user nova-compute[71312]:     <tpm supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-tis</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-crb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>passthrough</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>emulator</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </tpm>
Jul 25 09:56:17 user nova-compute[71312]:   </devices>
Jul 25 09:56:17 user nova-compute[71312]:   <features>
Jul 25 09:56:17 user nova-compute[71312]:     <gic supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <genid supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backup supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <sev supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:   </features>
Jul 25 09:56:17 user nova-compute[71312]: </domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 25 09:56:17 user nova-compute[71312]: <domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 25 09:56:17 user nova-compute[71312]:   <domain>kvm</domain>
Jul 25 09:56:17 user nova-compute[71312]:   <machine>pc-q35-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:   <arch>x86_64</arch>
Jul 25 09:56:17 user nova-compute[71312]:   <vcpu max='288'/>
Jul 25 09:56:17 user nova-compute[71312]:   <iothreads supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:   <os supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='firmware'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>efi</value>
Jul 25 09:56:17 user nova-compute[71312]:     </enum>
Jul 25 09:56:17 user nova-compute[71312]:     <loader supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>rom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pflash</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='readonly'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>yes</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='secure'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>yes</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </loader>
Jul 25 09:56:17 user nova-compute[71312]:   </os>
Jul 25 09:56:17 user nova-compute[71312]:   <cpu>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>on</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='maximumMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>on</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <vendor>Intel</vendor>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='invtsc'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='rsba'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='pschange-mc-no'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>phenom</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>n270</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>kvm64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>core2duo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>athlon</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Westmere-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Westmere</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Penryn</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Opteron_G1</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Nehalem</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Conroe</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>486</model>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:   </cpu>
Jul 25 09:56:17 user nova-compute[71312]:   <memoryBacking supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='sourceType'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>file</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>anonymous</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>memfd</value>
Jul 25 09:56:17 user nova-compute[71312]:     </enum>
Jul 25 09:56:17 user nova-compute[71312]:   </memoryBacking>
Jul 25 09:56:17 user nova-compute[71312]:   <devices>
Jul 25 09:56:17 user nova-compute[71312]:     <disk supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='diskDevice'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>disk</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cdrom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>floppy</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>lun</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='bus'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>fdc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sata</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </disk>
Jul 25 09:56:17 user nova-compute[71312]:     <graphics supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sdl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vnc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>spice</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egl-headless</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </graphics>
Jul 25 09:56:17 user nova-compute[71312]:     <video supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='modelType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cirrus</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vmvga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>qxl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>none</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>bochs</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>ramfb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </video>
Jul 25 09:56:17 user nova-compute[71312]:     <hostdev supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='mode'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>subsystem</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='startupPolicy'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>default</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>mandatory</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>requisite</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>optional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='subsysType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pci</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='capsType'/>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='pciBackend'/>
Jul 25 09:56:17 user nova-compute[71312]:     </hostdev>
Jul 25 09:56:17 user nova-compute[71312]:     <rng supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>random</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egd</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>builtin</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </rng>
Jul 25 09:56:17 user nova-compute[71312]:     <filesystem supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='driverType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>path</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>handle</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtiofs</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </filesystem>
Jul 25 09:56:17 user nova-compute[71312]:     <tpm supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-tis</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-crb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>passthrough</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>emulator</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </tpm>
Jul 25 09:56:17 user nova-compute[71312]:   </devices>
Jul 25 09:56:17 user nova-compute[71312]:   <features>
Jul 25 09:56:17 user nova-compute[71312]:     <gic supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <genid supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backup supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <sev supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:   </features>
Jul 25 09:56:17 user nova-compute[71312]: </domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 25 09:56:17 user nova-compute[71312]: <domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 25 09:56:17 user nova-compute[71312]:   <domain>kvm</domain>
Jul 25 09:56:17 user nova-compute[71312]:   <machine>pc-q35-jammy</machine>
Jul 25 09:56:17 user nova-compute[71312]:   <arch>x86_64</arch>
Jul 25 09:56:17 user nova-compute[71312]:   <vcpu max='288'/>
Jul 25 09:56:17 user nova-compute[71312]:   <iothreads supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:   <os supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='firmware'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>efi</value>
Jul 25 09:56:17 user nova-compute[71312]:     </enum>
Jul 25 09:56:17 user nova-compute[71312]:     <loader supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>rom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pflash</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='readonly'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>yes</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='secure'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>yes</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </loader>
Jul 25 09:56:17 user nova-compute[71312]:   </os>
Jul 25 09:56:17 user nova-compute[71312]:   <cpu>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>on</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='maximumMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>on</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <vendor>Intel</vendor>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='invtsc'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='rsba'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='pschange-mc-no'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>phenom</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>n270</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>kvm64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>core2duo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>athlon</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Westmere-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Westmere</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Penryn</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Opteron_G1</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Nehalem</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Conroe</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>486</model>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:   </cpu>
Jul 25 09:56:17 user nova-compute[71312]:   <memoryBacking supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='sourceType'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>file</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>anonymous</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>memfd</value>
Jul 25 09:56:17 user nova-compute[71312]:     </enum>
Jul 25 09:56:17 user nova-compute[71312]:   </memoryBacking>
Jul 25 09:56:17 user nova-compute[71312]:   <devices>
Jul 25 09:56:17 user nova-compute[71312]:     <disk supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='diskDevice'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>disk</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cdrom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>floppy</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>lun</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='bus'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>fdc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sata</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </disk>
Jul 25 09:56:17 user nova-compute[71312]:     <graphics supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sdl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vnc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>spice</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egl-headless</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </graphics>
Jul 25 09:56:17 user nova-compute[71312]:     <video supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='modelType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cirrus</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vmvga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>qxl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>none</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>bochs</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>ramfb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </video>
Jul 25 09:56:17 user nova-compute[71312]:     <hostdev supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='mode'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>subsystem</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='startupPolicy'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>default</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>mandatory</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>requisite</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>optional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='subsysType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pci</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='capsType'/>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='pciBackend'/>
Jul 25 09:56:17 user nova-compute[71312]:     </hostdev>
Jul 25 09:56:17 user nova-compute[71312]:     <rng supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>random</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egd</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>builtin</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </rng>
Jul 25 09:56:17 user nova-compute[71312]:     <filesystem supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='driverType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>path</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>handle</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtiofs</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </filesystem>
Jul 25 09:56:17 user nova-compute[71312]:     <tpm supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-tis</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-crb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>passthrough</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>emulator</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </tpm>
Jul 25 09:56:17 user nova-compute[71312]:   </devices>
Jul 25 09:56:17 user nova-compute[71312]:   <features>
Jul 25 09:56:17 user nova-compute[71312]:     <gic supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <genid supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backup supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <sev supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:   </features>
Jul 25 09:56:17 user nova-compute[71312]: </domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 25 09:56:17 user nova-compute[71312]: <domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 25 09:56:17 user nova-compute[71312]:   <domain>kvm</domain>
Jul 25 09:56:17 user nova-compute[71312]:   <machine>pc-i440fx-6.2</machine>
Jul 25 09:56:17 user nova-compute[71312]:   <arch>x86_64</arch>
Jul 25 09:56:17 user nova-compute[71312]:   <vcpu max='255'/>
Jul 25 09:56:17 user nova-compute[71312]:   <iothreads supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:   <os supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='firmware'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>efi</value>
Jul 25 09:56:17 user nova-compute[71312]:     </enum>
Jul 25 09:56:17 user nova-compute[71312]:     <loader supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>rom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pflash</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='readonly'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>yes</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='secure'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </loader>
Jul 25 09:56:17 user nova-compute[71312]:   </os>
Jul 25 09:56:17 user nova-compute[71312]:   <cpu>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>on</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='maximumMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>on</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <vendor>Intel</vendor>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='invtsc'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='rsba'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='pschange-mc-no'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>phenom</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>n270</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>kvm64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>core2duo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>athlon</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Westmere-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Westmere</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Penryn</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Opteron_G1</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Nehalem</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Conroe</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>486</model>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:   </cpu>
Jul 25 09:56:17 user nova-compute[71312]:   <memoryBacking supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='sourceType'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>file</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>anonymous</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>memfd</value>
Jul 25 09:56:17 user nova-compute[71312]:     </enum>
Jul 25 09:56:17 user nova-compute[71312]:   </memoryBacking>
Jul 25 09:56:17 user nova-compute[71312]:   <devices>
Jul 25 09:56:17 user nova-compute[71312]:     <disk supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='diskDevice'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>disk</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cdrom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>floppy</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>lun</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='bus'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>ide</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>fdc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sata</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </disk>
Jul 25 09:56:17 user nova-compute[71312]:     <graphics supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sdl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vnc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>spice</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egl-headless</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </graphics>
Jul 25 09:56:17 user nova-compute[71312]:     <video supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='modelType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cirrus</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vmvga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>qxl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>none</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>bochs</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>ramfb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </video>
Jul 25 09:56:17 user nova-compute[71312]:     <hostdev supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='mode'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>subsystem</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='startupPolicy'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>default</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>mandatory</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>requisite</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>optional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='subsysType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pci</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='capsType'/>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='pciBackend'/>
Jul 25 09:56:17 user nova-compute[71312]:     </hostdev>
Jul 25 09:56:17 user nova-compute[71312]:     <rng supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>random</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egd</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>builtin</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </rng>
Jul 25 09:56:17 user nova-compute[71312]:     <filesystem supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='driverType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>path</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>handle</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtiofs</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </filesystem>
Jul 25 09:56:17 user nova-compute[71312]:     <tpm supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-tis</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-crb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>passthrough</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>emulator</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </tpm>
Jul 25 09:56:17 user nova-compute[71312]:   </devices>
Jul 25 09:56:17 user nova-compute[71312]:   <features>
Jul 25 09:56:17 user nova-compute[71312]:     <gic supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <genid supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backup supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <sev supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:   </features>
Jul 25 09:56:17 user nova-compute[71312]: </domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 25 09:56:17 user nova-compute[71312]: <domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 25 09:56:17 user nova-compute[71312]:   <domain>kvm</domain>
Jul 25 09:56:17 user nova-compute[71312]:   <machine>pc-i440fx-jammy</machine>
Jul 25 09:56:17 user nova-compute[71312]:   <arch>x86_64</arch>
Jul 25 09:56:17 user nova-compute[71312]:   <vcpu max='255'/>
Jul 25 09:56:17 user nova-compute[71312]:   <iothreads supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:   <os supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='firmware'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>efi</value>
Jul 25 09:56:17 user nova-compute[71312]:     </enum>
Jul 25 09:56:17 user nova-compute[71312]:     <loader supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>rom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pflash</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='readonly'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>yes</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='secure'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>no</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </loader>
Jul 25 09:56:17 user nova-compute[71312]:   </os>
Jul 25 09:56:17 user nova-compute[71312]:   <cpu>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>on</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='maximumMigratable'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>on</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>off</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <vendor>Intel</vendor>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='invtsc'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='rsba'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='require' name='pschange-mc-no'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Jul 25 09:56:17 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>phenom</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>n270</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>kvm64</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>core2duo</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>athlon</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Westmere-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Westmere</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Penryn</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Opteron_G1</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Nehalem</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>Conroe</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Jul 25 09:56:17 user nova-compute[71312]:       <model usable='yes'>486</model>
Jul 25 09:56:17 user nova-compute[71312]:     </mode>
Jul 25 09:56:17 user nova-compute[71312]:   </cpu>
Jul 25 09:56:17 user nova-compute[71312]:   <memoryBacking supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:     <enum name='sourceType'>
Jul 25 09:56:17 user nova-compute[71312]:       <value>file</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>anonymous</value>
Jul 25 09:56:17 user nova-compute[71312]:       <value>memfd</value>
Jul 25 09:56:17 user nova-compute[71312]:     </enum>
Jul 25 09:56:17 user nova-compute[71312]:   </memoryBacking>
Jul 25 09:56:17 user nova-compute[71312]:   <devices>
Jul 25 09:56:17 user nova-compute[71312]:     <disk supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='diskDevice'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>disk</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cdrom</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>floppy</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>lun</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='bus'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>ide</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>fdc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sata</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </disk>
Jul 25 09:56:17 user nova-compute[71312]:     <graphics supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='type'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>sdl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vnc</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>spice</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egl-headless</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </graphics>
Jul 25 09:56:17 user nova-compute[71312]:     <video supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='modelType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>cirrus</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>vmvga</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>qxl</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>none</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>bochs</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>ramfb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </video>
Jul 25 09:56:17 user nova-compute[71312]:     <hostdev supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='mode'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>subsystem</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='startupPolicy'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>default</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>mandatory</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>requisite</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>optional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='subsysType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>usb</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>pci</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>scsi</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='capsType'/>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='pciBackend'/>
Jul 25 09:56:17 user nova-compute[71312]:     </hostdev>
Jul 25 09:56:17 user nova-compute[71312]:     <rng supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>random</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>egd</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>builtin</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </rng>
Jul 25 09:56:17 user nova-compute[71312]:     <filesystem supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='driverType'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>path</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>handle</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>virtiofs</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </filesystem>
Jul 25 09:56:17 user nova-compute[71312]:     <tpm supported='yes'>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='model'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-tis</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>tpm-crb</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:       <enum name='backendModel'>
Jul 25 09:56:17 user nova-compute[71312]:         <value>passthrough</value>
Jul 25 09:56:17 user nova-compute[71312]:         <value>emulator</value>
Jul 25 09:56:17 user nova-compute[71312]:       </enum>
Jul 25 09:56:17 user nova-compute[71312]:     </tpm>
Jul 25 09:56:17 user nova-compute[71312]:   </devices>
Jul 25 09:56:17 user nova-compute[71312]:   <features>
Jul 25 09:56:17 user nova-compute[71312]:     <gic supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <genid supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <backup supported='yes'/>
Jul 25 09:56:17 user nova-compute[71312]:     <sev supported='no'/>
Jul 25 09:56:17 user nova-compute[71312]:   </features>
Jul 25 09:56:17 user nova-compute[71312]: </domainCapabilities>
Jul 25 09:56:17 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Checking secure boot support for host arch (x86_64) {{(pid=71312) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 25 09:56:17 user nova-compute[71312]: INFO nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Secure Boot support detected
Jul 25 09:56:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] cpu compare xml: <cpu match="exact">
Jul 25 09:56:17 user nova-compute[71312]:   <model>Nehalem</model>
Jul 25 09:56:17 user nova-compute[71312]: </cpu>
Jul 25 09:56:17 user nova-compute[71312]:  {{(pid=71312) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 25 09:56:17 user nova-compute[71312]: INFO nova.virt.node [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Generated node identity c43d9a23-2919-4969-9b66-f1d29eb9e809
Jul 25 09:56:17 user nova-compute[71312]: INFO nova.virt.node [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Wrote node identity c43d9a23-2919-4969-9b66-f1d29eb9e809 to /opt/stack/data/nova/compute_id
Jul 25 09:56:17 user nova-compute[71312]: WARNING nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Compute nodes ['c43d9a23-2919-4969-9b66-f1d29eb9e809'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 25 09:56:18 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 25 09:56:18 user nova-compute[71312]: WARNING nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 25 09:56:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 09:56:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 09:56:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 09:56:18 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 09:56:18 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 09:56:18 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 09:56:18 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Hypervisor/Node resource view: name=user free_ram=10872MB free_disk=26.27968978881836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 09:56:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 09:56:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 09:56:18 user nova-compute[71312]: WARNING nova.compute.resource_tracker [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] No compute node record for user:c43d9a23-2919-4969-9b66-f1d29eb9e809: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host c43d9a23-2919-4969-9b66-f1d29eb9e809 could not be found.
Jul 25 09:56:18 user nova-compute[71312]: INFO nova.compute.resource_tracker [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Compute node record created for user:user with uuid: c43d9a23-2919-4969-9b66-f1d29eb9e809
Jul 25 09:56:18 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 09:56:18 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 09:56:18 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [req-2ca61a32-216b-4b11-991a-692d504b3a65] Created resource provider record via placement API for resource provider with UUID c43d9a23-2919-4969-9b66-f1d29eb9e809 and name user.
Jul 25 09:56:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71312) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 25 09:56:18 user nova-compute[71312]: INFO nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] kernel doesn't support AMD SEV
Jul 25 09:56:18 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Updating inventory in ProviderTree for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 09:56:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 09:56:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Libvirt baseline CPU <cpu>
Jul 25 09:56:18 user nova-compute[71312]:   <arch>x86_64</arch>
Jul 25 09:56:18 user nova-compute[71312]:   <model>Nehalem</model>
Jul 25 09:56:18 user nova-compute[71312]:   <vendor>Intel</vendor>
Jul 25 09:56:18 user nova-compute[71312]:   <topology sockets="6" cores="1" threads="1"/>
Jul 25 09:56:18 user nova-compute[71312]: </cpu>
Jul 25 09:56:18 user nova-compute[71312]:  {{(pid=71312) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 25 09:56:18 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Updated inventory for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 25 09:56:18 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Updating resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809 generation from 0 to 1 during operation: update_inventory {{(pid=71312) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 25 09:56:18 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Updating inventory in ProviderTree for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 09:56:18 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Updating resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809 generation from 1 to 2 during operation: update_traits {{(pid=71312) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 25 09:56:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 09:56:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.660s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 09:56:19 user nova-compute[71312]: DEBUG nova.service [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Creating RPC server for service compute {{(pid=71312) start /opt/stack/nova/nova/service.py:182}}
Jul 25 09:56:19 user nova-compute[71312]: DEBUG nova.service [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Join ServiceGroup membership for this service compute {{(pid=71312) start /opt/stack/nova/nova/service.py:199}}
Jul 25 09:56:19 user nova-compute[71312]: DEBUG nova.servicegroup.drivers.db [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71312) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 25 09:56:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_power_states {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:56:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 09:57:09 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 09:57:10 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 09:57:10 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 09:57:10 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=10238MB free_disk=26.183727264404297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 09:57:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 09:57:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 09:57:10 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 09:57:10 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 09:57:10 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 09:57:10 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 09:57:10 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 09:57:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 09:58:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:58:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:58:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:58:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:58:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 09:58:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:58:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:58:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:58:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 09:58:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 09:58:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 09:58:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:58:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:58:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 09:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 09:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 09:58:11 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 09:58:12 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 09:58:12 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 09:58:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=10182MB free_disk=26.22876739501953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 09:58:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 09:58:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 09:58:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 09:58:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 09:58:12 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 09:58:12 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 09:58:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 09:58:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 09:59:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:59:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:59:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 09:59:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:59:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:59:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:59:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:59:12 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:59:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 09:59:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 09:59:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 09:59:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:59:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 09:59:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 09:59:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 09:59:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 09:59:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 09:59:14 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 09:59:14 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 09:59:14 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=10174MB free_disk=26.00273895263672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 09:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 09:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 09:59:14 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 09:59:14 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 09:59:14 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 09:59:14 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 09:59:14 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 09:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:00:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:00:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:00:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:00:12 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:00:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:00:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:00:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 10:00:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 10:00:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:00:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:00:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:00:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:00:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:00:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:00:14 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:14 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:14 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=9463MB free_disk=26.02585220336914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:00:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:14 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:00:14 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:00:14 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:00:14 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:00:14 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:00:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:00:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:00:27 user nova-compute[71312]: INFO nova.compute.claims [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Claim successful on node user
Jul 25 10:00:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "621e0aaf-d2c9-4269-9085-177fa5e1536b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:00:28 user nova-compute[71312]: INFO nova.compute.claims [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Claim successful on node user
Jul 25 10:00:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:00:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:00:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:00:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Creating image(s)
Jul 25 10:00:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "/opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "/opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "/opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:00:28 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.999s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "5823c859-058e-4b2f-91b0-0e4def11bebf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG nova.policy [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c48272d2a58644b2b8b6a9c42b51c746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cb9228183844d5853c6c2a35f2658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62.part --force-share --output=json" returned: 0 in 0.196s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG nova.virt.images [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8 was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62.part /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:00:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:00:29 user nova-compute[71312]: INFO nova.compute.claims [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Claim successful on node user
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62.part /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62.converted" returned: 0 in 0.333s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:00:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Creating image(s)
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "/opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "/opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "/opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.policy [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30aeb8024651463b8d1290e405c5fe12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b99872ef56f4971ba1d5a8aff32ba10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.136s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:30 user nova-compute[71312]: INFO oslo.privsep.daemon [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpa5kp_uff/privsep.sock']
Jul 25 10:00:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.091s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:30 user sudo[80461]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpa5kp_uff/privsep.sock
Jul 25 10:00:30 user sudo[80461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.529s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:00:30 user nova-compute[71312]: INFO nova.compute.claims [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Claim successful on node user
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:00:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:00:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Creating image(s)
Jul 25 10:00:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "/opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "/opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.policy [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5186cf6b19094cb2948a2d4f966f3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ace30139b94322bdc7a657d3546757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:00:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:00:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Creating image(s)
Jul 25 10:00:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "/opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "/opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "/opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:31 user nova-compute[71312]: DEBUG nova.policy [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96d25383d4b6448da2d30479a26bfa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14fcd7739f41eabc9e7120f5b58a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:00:31 user sudo[80461]: pam_unix(sudo:session): session closed for user root
Jul 25 10:00:31 user nova-compute[71312]: INFO oslo.privsep.daemon [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Spawned new privsep daemon via rootwrap
Jul 25 10:00:31 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 25 10:00:31 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 25 10:00:31 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 25 10:00:31 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80465
Jul 25 10:00:31 user nova-compute[71312]: WARNING oslo_privsep.priv_context [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] privsep daemon already running
Jul 25 10:00:31 user nova-compute[71312]: WARNING oslo_privsep.priv_context [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] privsep daemon already running
Jul 25 10:00:31 user nova-compute[71312]: WARNING oslo_privsep.priv_context [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] privsep daemon already running
Jul 25 10:00:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Successfully created port: c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.189s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.203s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Successfully created port: dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk 1073741824" returned: 0 in 0.054s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.195s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Cannot resize image /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'migration_context' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk 1073741824" returned: 0 in 0.126s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.496s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Ensure instance console log exists: /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.120s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.189s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk 1073741824" returned: 0 in 0.070s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.695s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Cannot resize image /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'migration_context' on Instance uuid 5823c859-058e-4b2f-91b0-0e4def11bebf {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Ensure instance console log exists: /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.160s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Checking if we can resize image /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:00:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.166s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk 1073741824" returned: 0 in 0.046s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Cannot resize image /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lazy-loading 'migration_context' on Instance uuid 621e0aaf-d2c9-4269-9085-177fa5e1536b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Ensure instance console log exists: /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Cannot resize image /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG nova.objects.instance [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lazy-loading 'migration_context' on Instance uuid 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Ensure instance console log exists: /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:33 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:00:33 user nova-compute[71312]: INFO nova.compute.claims [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Claim successful on node user
Jul 25 10:00:34 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Successfully created port: 6d07c46c-fbbc-4e54-9261-0cd213bbb4ca {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:00:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:00:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Successfully created port: 8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:00:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Creating image(s)
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "/opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "/opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG nova.policy [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2cfdced66e34e0ba7f9437e71aaee6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30d33a1a8945fdab6798c94a558444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Successfully updated port: c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquired lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk 1073741824" returned: 0 in 0.048s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-29b6805d-090f-4d58-a20c-f9c0132fbeaa req-43f09696-e2b8-421e-880b-69eb6280fcf9 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-changed-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-29b6805d-090f-4d58-a20c-f9c0132fbeaa req-43f09696-e2b8-421e-880b-69eb6280fcf9 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Refreshing instance network info cache due to event network-changed-c8954e08-0e8d-41ae-9080-1eb363124b32. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-29b6805d-090f-4d58-a20c-f9c0132fbeaa req-43f09696-e2b8-421e-880b-69eb6280fcf9 service nova] Acquiring lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Cannot resize image /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'migration_context' on Instance uuid bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Ensure instance console log exists: /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Successfully updated port: dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "refresh_cache-621e0aaf-d2c9-4269-9085-177fa5e1536b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquired lock "refresh_cache-621e0aaf-d2c9-4269-9085-177fa5e1536b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-1c725df9-2569-4d3b-90dc-3de7da50b93e req-70e3a1ee-23a7-4a35-a8ab-2225df2bf29d service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Received event network-changed-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-1c725df9-2569-4d3b-90dc-3de7da50b93e req-70e3a1ee-23a7-4a35-a8ab-2225df2bf29d service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Refreshing instance network info cache due to event network-changed-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1c725df9-2569-4d3b-90dc-3de7da50b93e req-70e3a1ee-23a7-4a35-a8ab-2225df2bf29d service nova] Acquiring lock "refresh_cache-621e0aaf-d2c9-4269-9085-177fa5e1536b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Updating instance_info_cache with network_info: [{"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Releasing lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Instance network_info: |[{"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-29b6805d-090f-4d58-a20c-f9c0132fbeaa req-43f09696-e2b8-421e-880b-69eb6280fcf9 service nova] Acquired lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.network.neutron [req-29b6805d-090f-4d58-a20c-f9c0132fbeaa req-43f09696-e2b8-421e-880b-69eb6280fcf9 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Refreshing network info cache for port c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Start _get_guest_xml network_info=[{"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:00:35 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:35 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:00:35 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-144544124',display_name='tempest-AttachVolumeTestJSON-server-144544124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-144544124',id=1,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXz0IZaYzGqFbEgiNbRhFKdSJm7XWgEwVt5cEq+cvPNuokJAodyfDggfS0UAjnFMJC0mA942niA5C8O8meI4xtkMoQ/wHBJsXHFttAfgGOUxF17NM8ZbF6FsKSU7eOZoQ==',key_name='tempest-keypair-2122772756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68cb9228183844d5853c6c2a35f2658f',ramdisk_id='',reservation_id='r-il07codx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1095711794',owner_user_name='tempest-AttachVolumeTestJSON-1095711794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48272d2a58644b2b8b6a9c42b51c746',uuid=a35abe6a-0a8b-4eb2-8781-85b99539d1fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converting VIF {"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'pci_devices' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:00:36 user nova-compute[71312]:   <uuid>a35abe6a-0a8b-4eb2-8781-85b99539d1fc</uuid>
Jul 25 10:00:36 user nova-compute[71312]:   <name>instance-00000001</name>
Jul 25 10:00:36 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:00:36 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:00:36 user nova-compute[71312]:   <metadata>
Jul 25 10:00:36 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:00:36 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:00:36 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeTestJSON-server-144544124</nova:name>
Jul 25 10:00:36 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:00:35</nova:creationTime>
Jul 25 10:00:36 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:00:36 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:00:36 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:00:36 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:00:36 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:00:36 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:00:36 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:00:36 user nova-compute[71312]:       <nova:owner>
Jul 25 10:00:36 user nova-compute[71312]:         <nova:user uuid="c48272d2a58644b2b8b6a9c42b51c746">tempest-AttachVolumeTestJSON-1095711794-project-member</nova:user>
Jul 25 10:00:36 user nova-compute[71312]:         <nova:project uuid="68cb9228183844d5853c6c2a35f2658f">tempest-AttachVolumeTestJSON-1095711794</nova:project>
Jul 25 10:00:36 user nova-compute[71312]:       </nova:owner>
Jul 25 10:00:36 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:00:36 user nova-compute[71312]:       <nova:ports>
Jul 25 10:00:36 user nova-compute[71312]:         <nova:port uuid="c8954e08-0e8d-41ae-9080-1eb363124b32">
Jul 25 10:00:36 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 10:00:36 user nova-compute[71312]:         </nova:port>
Jul 25 10:00:36 user nova-compute[71312]:       </nova:ports>
Jul 25 10:00:36 user nova-compute[71312]:     </nova:instance>
Jul 25 10:00:36 user nova-compute[71312]:   </metadata>
Jul 25 10:00:36 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:00:36 user nova-compute[71312]:     <system>
Jul 25 10:00:36 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:00:36 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:00:36 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:00:36 user nova-compute[71312]:       <entry name="serial">a35abe6a-0a8b-4eb2-8781-85b99539d1fc</entry>
Jul 25 10:00:36 user nova-compute[71312]:       <entry name="uuid">a35abe6a-0a8b-4eb2-8781-85b99539d1fc</entry>
Jul 25 10:00:36 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:00:36 user nova-compute[71312]:     </system>
Jul 25 10:00:36 user nova-compute[71312]:   </sysinfo>
Jul 25 10:00:36 user nova-compute[71312]:   <os>
Jul 25 10:00:36 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:00:36 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:00:36 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:00:36 user nova-compute[71312]:   </os>
Jul 25 10:00:36 user nova-compute[71312]:   <features>
Jul 25 10:00:36 user nova-compute[71312]:     <acpi/>
Jul 25 10:00:36 user nova-compute[71312]:     <apic/>
Jul 25 10:00:36 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:00:36 user nova-compute[71312]:   </features>
Jul 25 10:00:36 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:00:36 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:00:36 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:00:36 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:00:36 user nova-compute[71312]:   </clock>
Jul 25 10:00:36 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:00:36 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:00:36 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:00:36 user nova-compute[71312]:   </cpu>
Jul 25 10:00:36 user nova-compute[71312]:   <devices>
Jul 25 10:00:36 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:00:36 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:00:36 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk"/>
Jul 25 10:00:36 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:00:36 user nova-compute[71312]:     </disk>
Jul 25 10:00:36 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:00:36 user nova-compute[71312]:       <mac address="fa:16:3e:3d:6d:80"/>
Jul 25 10:00:36 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:36 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:00:36 user nova-compute[71312]:       <target dev="tapc8954e08-0e"/>
Jul 25 10:00:36 user nova-compute[71312]:     </interface>
Jul 25 10:00:36 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:00:36 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/console.log" append="off"/>
Jul 25 10:00:36 user nova-compute[71312]:     </serial>
Jul 25 10:00:36 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:00:36 user nova-compute[71312]:     <video>
Jul 25 10:00:36 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:36 user nova-compute[71312]:     </video>
Jul 25 10:00:36 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:00:36 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:00:36 user nova-compute[71312]:     </rng>
Jul 25 10:00:36 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:00:36 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:00:36 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:00:36 user nova-compute[71312]:     </memballoon>
Jul 25 10:00:36 user nova-compute[71312]:   </devices>
Jul 25 10:00:36 user nova-compute[71312]: </domain>
Jul 25 10:00:36 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-144544124',display_name='tempest-AttachVolumeTestJSON-server-144544124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-144544124',id=1,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXz0IZaYzGqFbEgiNbRhFKdSJm7XWgEwVt5cEq+cvPNuokJAodyfDggfS0UAjnFMJC0mA942niA5C8O8meI4xtkMoQ/wHBJsXHFttAfgGOUxF17NM8ZbF6FsKSU7eOZoQ==',key_name='tempest-keypair-2122772756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68cb9228183844d5853c6c2a35f2658f',ramdisk_id='',reservation_id='r-il07codx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1095711794',owner_user_name='tempest-AttachVolumeTestJSON-1095711794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48272d2a58644b2b8b6a9c42b51c746',uuid=a35abe6a-0a8b-4eb2-8781-85b99539d1fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converting VIF {"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG os_vif [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Created schema index Interface.name {{(pid=71312) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Created schema index Port.name {{(pid=71312) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Created schema index Bridge.name {{(pid=71312) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [POLLOUT] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:00:36 user nova-compute[71312]: INFO oslo.privsep.daemon [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpyhm8rxkh/privsep.sock']
Jul 25 10:00:36 user sudo[80546]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpyhm8rxkh/privsep.sock
Jul 25 10:00:36 user sudo[80546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 25 10:00:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Successfully created port: d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Updating instance_info_cache with network_info: [{"id": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "address": "fa:16:3e:d0:d2:02", "network": {"id": "6e5b6ffe-9a3e-434f-94bd-7954911aa6e1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-531293470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b99872ef56f4971ba1d5a8aff32ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7d3563-fd", "ovs_interfaceid": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Releasing lock "refresh_cache-621e0aaf-d2c9-4269-9085-177fa5e1536b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Instance network_info: |[{"id": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "address": "fa:16:3e:d0:d2:02", "network": {"id": "6e5b6ffe-9a3e-434f-94bd-7954911aa6e1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-531293470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b99872ef56f4971ba1d5a8aff32ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7d3563-fd", "ovs_interfaceid": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1c725df9-2569-4d3b-90dc-3de7da50b93e req-70e3a1ee-23a7-4a35-a8ab-2225df2bf29d service nova] Acquired lock "refresh_cache-621e0aaf-d2c9-4269-9085-177fa5e1536b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-1c725df9-2569-4d3b-90dc-3de7da50b93e req-70e3a1ee-23a7-4a35-a8ab-2225df2bf29d service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Refreshing network info cache for port dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Start _get_guest_xml network_info=[{"id": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "address": "fa:16:3e:d0:d2:02", "network": {"id": "6e5b6ffe-9a3e-434f-94bd-7954911aa6e1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-531293470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b99872ef56f4971ba1d5a8aff32ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7d3563-fd", "ovs_interfaceid": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:00:37 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:37 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1643577833',display_name='tempest-DeleteServersTestJSON-server-1643577833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1643577833',id=2,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b99872ef56f4971ba1d5a8aff32ba10',ramdisk_id='',reservation_id='r-1jl1fz4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-227894336',owner_user_name='tempest-DeleteServersTestJSON-227894336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:30Z,user_data=None,user_id='30aeb8024651463b8d1290e405c5fe12',uuid=621e0aaf-d2c9-4269-9085-177fa5e1536b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "address": "fa:16:3e:d0:d2:02", "network": {"id": "6e5b6ffe-9a3e-434f-94bd-7954911aa6e1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-531293470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b99872ef56f4971ba1d5a8aff32ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7d3563-fd", "ovs_interfaceid": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Converting VIF {"id": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "address": "fa:16:3e:d0:d2:02", "network": {"id": "6e5b6ffe-9a3e-434f-94bd-7954911aa6e1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-531293470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b99872ef56f4971ba1d5a8aff32ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7d3563-fd", "ovs_interfaceid": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:d2:02,bridge_name='br-int',has_traffic_filtering=True,id=dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8,network=Network(6e5b6ffe-9a3e-434f-94bd-7954911aa6e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7d3563-fd') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lazy-loading 'pci_devices' on Instance uuid 621e0aaf-d2c9-4269-9085-177fa5e1536b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:00:37 user nova-compute[71312]:   <uuid>621e0aaf-d2c9-4269-9085-177fa5e1536b</uuid>
Jul 25 10:00:37 user nova-compute[71312]:   <name>instance-00000002</name>
Jul 25 10:00:37 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:00:37 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:00:37 user nova-compute[71312]:   <metadata>
Jul 25 10:00:37 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:00:37 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:00:37 user nova-compute[71312]:       <nova:name>tempest-DeleteServersTestJSON-server-1643577833</nova:name>
Jul 25 10:00:37 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:00:37</nova:creationTime>
Jul 25 10:00:37 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:00:37 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:00:37 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:00:37 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:00:37 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:00:37 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:00:37 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:00:37 user nova-compute[71312]:       <nova:owner>
Jul 25 10:00:37 user nova-compute[71312]:         <nova:user uuid="30aeb8024651463b8d1290e405c5fe12">tempest-DeleteServersTestJSON-227894336-project-member</nova:user>
Jul 25 10:00:37 user nova-compute[71312]:         <nova:project uuid="4b99872ef56f4971ba1d5a8aff32ba10">tempest-DeleteServersTestJSON-227894336</nova:project>
Jul 25 10:00:37 user nova-compute[71312]:       </nova:owner>
Jul 25 10:00:37 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:00:37 user nova-compute[71312]:       <nova:ports>
Jul 25 10:00:37 user nova-compute[71312]:         <nova:port uuid="dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8">
Jul 25 10:00:37 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 10:00:37 user nova-compute[71312]:         </nova:port>
Jul 25 10:00:37 user nova-compute[71312]:       </nova:ports>
Jul 25 10:00:37 user nova-compute[71312]:     </nova:instance>
Jul 25 10:00:37 user nova-compute[71312]:   </metadata>
Jul 25 10:00:37 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:00:37 user nova-compute[71312]:     <system>
Jul 25 10:00:37 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:00:37 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:00:37 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:00:37 user nova-compute[71312]:       <entry name="serial">621e0aaf-d2c9-4269-9085-177fa5e1536b</entry>
Jul 25 10:00:37 user nova-compute[71312]:       <entry name="uuid">621e0aaf-d2c9-4269-9085-177fa5e1536b</entry>
Jul 25 10:00:37 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:00:37 user nova-compute[71312]:     </system>
Jul 25 10:00:37 user nova-compute[71312]:   </sysinfo>
Jul 25 10:00:37 user nova-compute[71312]:   <os>
Jul 25 10:00:37 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:00:37 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:00:37 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:00:37 user nova-compute[71312]:   </os>
Jul 25 10:00:37 user nova-compute[71312]:   <features>
Jul 25 10:00:37 user nova-compute[71312]:     <acpi/>
Jul 25 10:00:37 user nova-compute[71312]:     <apic/>
Jul 25 10:00:37 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:00:37 user nova-compute[71312]:   </features>
Jul 25 10:00:37 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:00:37 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:00:37 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:00:37 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:00:37 user nova-compute[71312]:   </clock>
Jul 25 10:00:37 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:00:37 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:00:37 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:00:37 user nova-compute[71312]:   </cpu>
Jul 25 10:00:37 user nova-compute[71312]:   <devices>
Jul 25 10:00:37 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:00:37 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:00:37 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk"/>
Jul 25 10:00:37 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:00:37 user nova-compute[71312]:     </disk>
Jul 25 10:00:37 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:00:37 user nova-compute[71312]:       <mac address="fa:16:3e:d0:d2:02"/>
Jul 25 10:00:37 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:37 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:00:37 user nova-compute[71312]:       <target dev="tapdd7d3563-fd"/>
Jul 25 10:00:37 user nova-compute[71312]:     </interface>
Jul 25 10:00:37 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:00:37 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/console.log" append="off"/>
Jul 25 10:00:37 user nova-compute[71312]:     </serial>
Jul 25 10:00:37 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:00:37 user nova-compute[71312]:     <video>
Jul 25 10:00:37 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:37 user nova-compute[71312]:     </video>
Jul 25 10:00:37 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:00:37 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:00:37 user nova-compute[71312]:     </rng>
Jul 25 10:00:37 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:00:37 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:00:37 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:00:37 user nova-compute[71312]:     </memballoon>
Jul 25 10:00:37 user nova-compute[71312]:   </devices>
Jul 25 10:00:37 user nova-compute[71312]: </domain>
Jul 25 10:00:37 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1643577833',display_name='tempest-DeleteServersTestJSON-server-1643577833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1643577833',id=2,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b99872ef56f4971ba1d5a8aff32ba10',ramdisk_id='',reservation_id='r-1jl1fz4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-227894336',owner_user_name='tempest-DeleteServersTestJSON-227894336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:30Z,user_data=None,user_id='30aeb8024651463b8d1290e405c5fe12',uuid=621e0aaf-d2c9-4269-9085-177fa5e1536b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "address": "fa:16:3e:d0:d2:02", "network": {"id": "6e5b6ffe-9a3e-434f-94bd-7954911aa6e1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-531293470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b99872ef56f4971ba1d5a8aff32ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7d3563-fd", "ovs_interfaceid": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Converting VIF {"id": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "address": "fa:16:3e:d0:d2:02", "network": {"id": "6e5b6ffe-9a3e-434f-94bd-7954911aa6e1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-531293470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b99872ef56f4971ba1d5a8aff32ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7d3563-fd", "ovs_interfaceid": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:d2:02,bridge_name='br-int',has_traffic_filtering=True,id=dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8,network=Network(6e5b6ffe-9a3e-434f-94bd-7954911aa6e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7d3563-fd') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG os_vif [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:d2:02,bridge_name='br-int',has_traffic_filtering=True,id=dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8,network=Network(6e5b6ffe-9a3e-434f-94bd-7954911aa6e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7d3563-fd') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-29b6805d-090f-4d58-a20c-f9c0132fbeaa req-43f09696-e2b8-421e-880b-69eb6280fcf9 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Updated VIF entry in instance network info cache for port c8954e08-0e8d-41ae-9080-1eb363124b32. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-29b6805d-090f-4d58-a20c-f9c0132fbeaa req-43f09696-e2b8-421e-880b-69eb6280fcf9 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Updating instance_info_cache with network_info: [{"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-29b6805d-090f-4d58-a20c-f9c0132fbeaa req-43f09696-e2b8-421e-880b-69eb6280fcf9 service nova] Releasing lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "297fe407-3797-4681-ba83-e0f296780d57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "297fe407-3797-4681-ba83-e0f296780d57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:00:37 user nova-compute[71312]: INFO nova.compute.claims [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Claim successful on node user
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Successfully updated port: 6d07c46c-fbbc-4e54-9261-0cd213bbb4ca {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquired lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Successfully updated port: 8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquired lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:00:37 user sudo[80546]: pam_unix(sudo:session): session closed for user root
Jul 25 10:00:37 user nova-compute[71312]: INFO oslo.privsep.daemon [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Spawned new privsep daemon via rootwrap
Jul 25 10:00:37 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 25 10:00:37 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 25 10:00:37 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 25 10:00:37 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80549
Jul 25 10:00:37 user nova-compute[71312]: WARNING oslo_privsep.priv_context [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] privsep daemon already running
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-d98c7810-cd98-4564-becf-2b1158096725 req-18045028-1c33-4ac6-bc0b-72de021b7acb service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Received event network-changed-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-d98c7810-cd98-4564-becf-2b1158096725 req-18045028-1c33-4ac6-bc0b-72de021b7acb service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Refreshing instance network info cache due to event network-changed-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d98c7810-cd98-4564-becf-2b1158096725 req-18045028-1c33-4ac6-bc0b-72de021b7acb service nova] Acquiring lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:00:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8954e08-0e, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8954e08-0e, col_values=(('external_ids', {'iface-id': 'c8954e08-0e8d-41ae-9080-1eb363124b32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:6d:80', 'vm-uuid': 'a35abe6a-0a8b-4eb2-8781-85b99539d1fc'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd7d3563-fd, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd7d3563-fd, col_values=(('external_ids', {'iface-id': 'dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:d2:02', 'vm-uuid': '621e0aaf-d2c9-4269-9085-177fa5e1536b'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:38 user nova-compute[71312]: INFO os_vif [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e')
Jul 25 10:00:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.policy [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fe1a69013de4b4dbcb98a35e48d8ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a09fcc394c945c2b843abf3df53cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:00:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Creating image(s)
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "/opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "/opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "/opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Successfully updated port: d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:00:38 user nova-compute[71312]: INFO os_vif [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:d2:02,bridge_name='br-int',has_traffic_filtering=True,id=dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8,network=Network(6e5b6ffe-9a3e-434f-94bd-7954911aa6e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7d3563-fd')
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquired lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-cd4ccd54-2e67-48fd-bb12-f078f7d6399a req-0f8bfdd7-06d6-493b-8dd1-2b199cff5f9e service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-changed-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-cd4ccd54-2e67-48fd-bb12-f078f7d6399a req-0f8bfdd7-06d6-493b-8dd1-2b199cff5f9e service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Refreshing instance network info cache due to event network-changed-d1cb436a-ed84-43ea-a32f-6c08effc60d6. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cd4ccd54-2e67-48fd-bb12-f078f7d6399a req-0f8bfdd7-06d6-493b-8dd1-2b199cff5f9e service nova] Acquiring lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] No VIF found with MAC fa:16:3e:d0:d2:02, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.123s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] No VIF found with MAC fa:16:3e:3d:6d:80, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:00:38 user nova-compute[71312]: INFO nova.compute.claims [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Claim successful on node user
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-1c725df9-2569-4d3b-90dc-3de7da50b93e req-70e3a1ee-23a7-4a35-a8ab-2225df2bf29d service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Updated VIF entry in instance network info cache for port dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-1c725df9-2569-4d3b-90dc-3de7da50b93e req-70e3a1ee-23a7-4a35-a8ab-2225df2bf29d service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Updating instance_info_cache with network_info: [{"id": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "address": "fa:16:3e:d0:d2:02", "network": {"id": "6e5b6ffe-9a3e-434f-94bd-7954911aa6e1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-531293470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b99872ef56f4971ba1d5a8aff32ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7d3563-fd", "ovs_interfaceid": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk 1073741824" returned: 0 in 0.043s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1c725df9-2569-4d3b-90dc-3de7da50b93e req-70e3a1ee-23a7-4a35-a8ab-2225df2bf29d service nova] Releasing lock "refresh_cache-621e0aaf-d2c9-4269-9085-177fa5e1536b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Cannot resize image /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.objects.instance [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'migration_context' on Instance uuid 297fe407-3797-4681-ba83-e0f296780d57 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Ensure instance console log exists: /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Updating instance_info_cache with network_info: [{"id": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "address": "fa:16:3e:60:b3:44", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d07c46c-fb", "ovs_interfaceid": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updating instance_info_cache with network_info: [{"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Releasing lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Instance network_info: |[{"id": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "address": "fa:16:3e:60:b3:44", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d07c46c-fb", "ovs_interfaceid": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:00:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d98c7810-cd98-4564-becf-2b1158096725 req-18045028-1c33-4ac6-bc0b-72de021b7acb service nova] Acquired lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.neutron [req-d98c7810-cd98-4564-becf-2b1158096725 req-18045028-1c33-4ac6-bc0b-72de021b7acb service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Refreshing network info cache for port 6d07c46c-fbbc-4e54-9261-0cd213bbb4ca {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Start _get_guest_xml network_info=[{"id": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "address": "fa:16:3e:60:b3:44", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d07c46c-fb", "ovs_interfaceid": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Releasing lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Instance network_info: |[{"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Start _get_guest_xml network_info=[{"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:00:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-724910394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-724910394',id=3,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b14fcd7739f41eabc9e7120f5b58a08',ramdisk_id='',reservation_id='r-fzulogf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-13369838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:31Z,user_data=None,user_id='96d25383d4b6448da2d30479a26bfa0f',uuid=5823c859-058e-4b2f-91b0-0e4def11bebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "address": "fa:16:3e:60:b3:44", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d07c46c-fb", "ovs_interfaceid": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converting VIF {"id": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "address": "fa:16:3e:60:b3:44", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d07c46c-fb", "ovs_interfaceid": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:b3:44,bridge_name='br-int',has_traffic_filtering=True,id=6d07c46c-fbbc-4e54-9261-0cd213bbb4ca,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d07c46c-fb') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.objects.instance [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'pci_devices' on Instance uuid 5823c859-058e-4b2f-91b0-0e4def11bebf {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704266463',display_name='tempest-ServerActionsTestOtherB-server-704266463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704266463',id=4,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeo1OyzMR1FuY3t9bxVf78EYsomUcs1GBJeQZ+xHk7Q6n7Ea0otdZoq9Stbi9efTSjxNpLsJBFIquobgg119YA0SZsVMkFCxXfGhMNAahmBkXlggOo2Y7cPMghqdLy6UQ==',key_name='tempest-keypair-1722521166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39ace30139b94322bdc7a657d3546757',ramdisk_id='',reservation_id='r-x9ogqxil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-766110382',owner_user_name='tempest-ServerActionsTestOtherB-766110382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5186cf6b19094cb2948a2d4f966f3dcc',uuid=9fb85501-6210-4bfd-b496-1891c79fd23c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converting VIF {"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.objects.instance [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:00:39 user nova-compute[71312]:   <uuid>5823c859-058e-4b2f-91b0-0e4def11bebf</uuid>
Jul 25 10:00:39 user nova-compute[71312]:   <name>instance-00000003</name>
Jul 25 10:00:39 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:00:39 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:00:39 user nova-compute[71312]:   <metadata>
Jul 25 10:00:39 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:00:39 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:00:39 user nova-compute[71312]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-724910394</nova:name>
Jul 25 10:00:39 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:00:39</nova:creationTime>
Jul 25 10:00:39 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:00:39 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:00:39 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:00:39 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:00:39 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:00:39 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:00:39 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:00:39 user nova-compute[71312]:       <nova:owner>
Jul 25 10:00:39 user nova-compute[71312]:         <nova:user uuid="96d25383d4b6448da2d30479a26bfa0f">tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member</nova:user>
Jul 25 10:00:39 user nova-compute[71312]:         <nova:project uuid="0b14fcd7739f41eabc9e7120f5b58a08">tempest-ServerBootFromVolumeStableRescueTest-13369838</nova:project>
Jul 25 10:00:39 user nova-compute[71312]:       </nova:owner>
Jul 25 10:00:39 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:00:39 user nova-compute[71312]:       <nova:ports>
Jul 25 10:00:39 user nova-compute[71312]:         <nova:port uuid="6d07c46c-fbbc-4e54-9261-0cd213bbb4ca">
Jul 25 10:00:39 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 10:00:39 user nova-compute[71312]:         </nova:port>
Jul 25 10:00:39 user nova-compute[71312]:       </nova:ports>
Jul 25 10:00:39 user nova-compute[71312]:     </nova:instance>
Jul 25 10:00:39 user nova-compute[71312]:   </metadata>
Jul 25 10:00:39 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:00:39 user nova-compute[71312]:     <system>
Jul 25 10:00:39 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:00:39 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:00:39 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:00:39 user nova-compute[71312]:       <entry name="serial">5823c859-058e-4b2f-91b0-0e4def11bebf</entry>
Jul 25 10:00:39 user nova-compute[71312]:       <entry name="uuid">5823c859-058e-4b2f-91b0-0e4def11bebf</entry>
Jul 25 10:00:39 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:00:39 user nova-compute[71312]:     </system>
Jul 25 10:00:39 user nova-compute[71312]:   </sysinfo>
Jul 25 10:00:39 user nova-compute[71312]:   <os>
Jul 25 10:00:39 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:00:39 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:00:39 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:00:39 user nova-compute[71312]:   </os>
Jul 25 10:00:39 user nova-compute[71312]:   <features>
Jul 25 10:00:39 user nova-compute[71312]:     <acpi/>
Jul 25 10:00:39 user nova-compute[71312]:     <apic/>
Jul 25 10:00:39 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:00:39 user nova-compute[71312]:   </features>
Jul 25 10:00:39 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:00:39 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:00:39 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:00:39 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:00:39 user nova-compute[71312]:   </clock>
Jul 25 10:00:39 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:00:39 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:00:39 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:00:39 user nova-compute[71312]:   </cpu>
Jul 25 10:00:39 user nova-compute[71312]:   <devices>
Jul 25 10:00:39 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:00:39 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:00:39 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk"/>
Jul 25 10:00:39 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:00:39 user nova-compute[71312]:     </disk>
Jul 25 10:00:39 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:00:39 user nova-compute[71312]:       <mac address="fa:16:3e:60:b3:44"/>
Jul 25 10:00:39 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:39 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:00:39 user nova-compute[71312]:       <target dev="tap6d07c46c-fb"/>
Jul 25 10:00:39 user nova-compute[71312]:     </interface>
Jul 25 10:00:39 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:00:39 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/console.log" append="off"/>
Jul 25 10:00:39 user nova-compute[71312]:     </serial>
Jul 25 10:00:39 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:00:39 user nova-compute[71312]:     <video>
Jul 25 10:00:39 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:39 user nova-compute[71312]:     </video>
Jul 25 10:00:39 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:00:39 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:00:39 user nova-compute[71312]:     </rng>
Jul 25 10:00:39 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:00:39 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:00:39 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:00:39 user nova-compute[71312]:     </memballoon>
Jul 25 10:00:39 user nova-compute[71312]:   </devices>
Jul 25 10:00:39 user nova-compute[71312]: </domain>
Jul 25 10:00:39 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-724910394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-724910394',id=3,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b14fcd7739f41eabc9e7120f5b58a08',ramdisk_id='',reservation_id='r-fzulogf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-13369838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:31Z,user_data=None,user_id='96d25383d4b6448da2d30479a26bfa0f',uuid=5823c859-058e-4b2f-91b0-0e4def11bebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "address": "fa:16:3e:60:b3:44", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d07c46c-fb", "ovs_interfaceid": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converting VIF {"id": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "address": "fa:16:3e:60:b3:44", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d07c46c-fb", "ovs_interfaceid": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:b3:44,bridge_name='br-int',has_traffic_filtering=True,id=6d07c46c-fbbc-4e54-9261-0cd213bbb4ca,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d07c46c-fb') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG os_vif [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:b3:44,bridge_name='br-int',has_traffic_filtering=True,id=6d07c46c-fbbc-4e54-9261-0cd213bbb4ca,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d07c46c-fb') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d07c46c-fb, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d07c46c-fb, col_values=(('external_ids', {'iface-id': '6d07c46c-fbbc-4e54-9261-0cd213bbb4ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:b3:44', 'vm-uuid': '5823c859-058e-4b2f-91b0-0e4def11bebf'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:00:39 user nova-compute[71312]:   <uuid>9fb85501-6210-4bfd-b496-1891c79fd23c</uuid>
Jul 25 10:00:39 user nova-compute[71312]:   <name>instance-00000004</name>
Jul 25 10:00:39 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:00:39 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:00:39 user nova-compute[71312]:   <metadata>
Jul 25 10:00:39 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:00:39 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:00:39 user nova-compute[71312]:       <nova:name>tempest-ServerActionsTestOtherB-server-704266463</nova:name>
Jul 25 10:00:39 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:00:39</nova:creationTime>
Jul 25 10:00:39 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:00:39 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:00:39 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:00:39 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:00:39 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:00:39 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:00:39 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:00:39 user nova-compute[71312]:       <nova:owner>
Jul 25 10:00:39 user nova-compute[71312]:         <nova:user uuid="5186cf6b19094cb2948a2d4f966f3dcc">tempest-ServerActionsTestOtherB-766110382-project-member</nova:user>
Jul 25 10:00:39 user nova-compute[71312]:         <nova:project uuid="39ace30139b94322bdc7a657d3546757">tempest-ServerActionsTestOtherB-766110382</nova:project>
Jul 25 10:00:39 user nova-compute[71312]:       </nova:owner>
Jul 25 10:00:39 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:00:39 user nova-compute[71312]:       <nova:ports>
Jul 25 10:00:39 user nova-compute[71312]:         <nova:port uuid="8727a126-c33f-4868-8651-45e7c1f663d2">
Jul 25 10:00:39 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:00:39 user nova-compute[71312]:         </nova:port>
Jul 25 10:00:39 user nova-compute[71312]:       </nova:ports>
Jul 25 10:00:39 user nova-compute[71312]:     </nova:instance>
Jul 25 10:00:39 user nova-compute[71312]:   </metadata>
Jul 25 10:00:39 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:00:39 user nova-compute[71312]:     <system>
Jul 25 10:00:39 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:00:39 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:00:39 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:00:39 user nova-compute[71312]:       <entry name="serial">9fb85501-6210-4bfd-b496-1891c79fd23c</entry>
Jul 25 10:00:39 user nova-compute[71312]:       <entry name="uuid">9fb85501-6210-4bfd-b496-1891c79fd23c</entry>
Jul 25 10:00:39 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:00:39 user nova-compute[71312]:     </system>
Jul 25 10:00:39 user nova-compute[71312]:   </sysinfo>
Jul 25 10:00:39 user nova-compute[71312]:   <os>
Jul 25 10:00:39 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:00:39 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:00:39 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:00:39 user nova-compute[71312]:   </os>
Jul 25 10:00:39 user nova-compute[71312]:   <features>
Jul 25 10:00:39 user nova-compute[71312]:     <acpi/>
Jul 25 10:00:39 user nova-compute[71312]:     <apic/>
Jul 25 10:00:39 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:00:39 user nova-compute[71312]:   </features>
Jul 25 10:00:39 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:00:39 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:00:39 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:00:39 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:00:39 user nova-compute[71312]:   </clock>
Jul 25 10:00:39 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:00:39 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:00:39 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:00:39 user nova-compute[71312]:   </cpu>
Jul 25 10:00:39 user nova-compute[71312]:   <devices>
Jul 25 10:00:39 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:00:39 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:00:39 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk"/>
Jul 25 10:00:39 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:00:39 user nova-compute[71312]:     </disk>
Jul 25 10:00:39 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:00:39 user nova-compute[71312]:       <mac address="fa:16:3e:60:72:df"/>
Jul 25 10:00:39 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:39 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:00:39 user nova-compute[71312]:       <target dev="tap8727a126-c3"/>
Jul 25 10:00:39 user nova-compute[71312]:     </interface>
Jul 25 10:00:39 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:00:39 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/console.log" append="off"/>
Jul 25 10:00:39 user nova-compute[71312]:     </serial>
Jul 25 10:00:39 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:00:39 user nova-compute[71312]:     <video>
Jul 25 10:00:39 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:39 user nova-compute[71312]:     </video>
Jul 25 10:00:39 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:00:39 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:00:39 user nova-compute[71312]:     </rng>
Jul 25 10:00:39 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:00:39 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:00:39 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:00:39 user nova-compute[71312]:     </memballoon>
Jul 25 10:00:39 user nova-compute[71312]:   </devices>
Jul 25 10:00:39 user nova-compute[71312]: </domain>
Jul 25 10:00:39 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704266463',display_name='tempest-ServerActionsTestOtherB-server-704266463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704266463',id=4,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeo1OyzMR1FuY3t9bxVf78EYsomUcs1GBJeQZ+xHk7Q6n7Ea0otdZoq9Stbi9efTSjxNpLsJBFIquobgg119YA0SZsVMkFCxXfGhMNAahmBkXlggOo2Y7cPMghqdLy6UQ==',key_name='tempest-keypair-1722521166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39ace30139b94322bdc7a657d3546757',ramdisk_id='',reservation_id='r-x9ogqxil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-766110382',owner_user_name='tempest-ServerActionsTestOtherB-766110382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5186cf6b19094cb2948a2d4f966f3dcc',uuid=9fb85501-6210-4bfd-b496-1891c79fd23c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converting VIF {"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG os_vif [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:00:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Creating image(s)
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "/opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "/opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.policy [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e2c8d915c3f4fdd8056f8b8651a6b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda42819655247c4bd852a6e41edeb69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:00:39 user nova-compute[71312]: INFO os_vif [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:b3:44,bridge_name='br-int',has_traffic_filtering=True,id=6d07c46c-fbbc-4e54-9261-0cd213bbb4ca,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d07c46c-fb')
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8727a126-c3, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8727a126-c3, col_values=(('external_ids', {'iface-id': '8727a126-c33f-4868-8651-45e7c1f663d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:72:df', 'vm-uuid': '9fb85501-6210-4bfd-b496-1891c79fd23c'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:39 user nova-compute[71312]: INFO os_vif [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3')
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] No VIF found with MAC fa:16:3e:60:b3:44, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updating instance_info_cache with network_info: [{"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Releasing lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Instance network_info: |[{"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cd4ccd54-2e67-48fd-bb12-f078f7d6399a req-0f8bfdd7-06d6-493b-8dd1-2b199cff5f9e service nova] Acquired lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.neutron [req-cd4ccd54-2e67-48fd-bb12-f078f7d6399a req-0f8bfdd7-06d6-493b-8dd1-2b199cff5f9e service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Refreshing network info cache for port d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Start _get_guest_xml network_info=[{"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] No VIF found with MAC fa:16:3e:60:72:df, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:00:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-164940161',display_name='tempest-ServerActionsTestOtherA-server-164940161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-164940161',id=5,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7/PiN27E1zNONLGfU75gjTzl6TjLJTSPguo/w/NLGiNWvcFBQAXJk/RsZr2x3/TDzaN8UL9NG26qh75+qbwT35akc6FqjZaWZn3poJMiar+SGmPPXZDxAQP/CqYmNQIw==',key_name='tempest-keypair-2143034637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c30d33a1a8945fdab6798c94a558444',ramdisk_id='',reservation_id='r-rxkl8cmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-408585031',owner_user_name='tempest-ServerActionsTestOtherA-408585031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfdced66e34e0ba7f9437e71aaee6a',uuid=bcc93774-32b0-4592-bf6a-d655bac21d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converting VIF {"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=d1cb436a-ed84-43ea-a32f-6c08effc60d6,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb436a-ed') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'pci_devices' on Instance uuid bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.180s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:00:40 user nova-compute[71312]:   <uuid>bcc93774-32b0-4592-bf6a-d655bac21d39</uuid>
Jul 25 10:00:40 user nova-compute[71312]:   <name>instance-00000005</name>
Jul 25 10:00:40 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:00:40 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:00:40 user nova-compute[71312]:   <metadata>
Jul 25 10:00:40 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:00:40 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:00:40 user nova-compute[71312]:       <nova:name>tempest-ServerActionsTestOtherA-server-164940161</nova:name>
Jul 25 10:00:40 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:00:39</nova:creationTime>
Jul 25 10:00:40 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:00:40 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:00:40 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:00:40 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:00:40 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:00:40 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:00:40 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:00:40 user nova-compute[71312]:       <nova:owner>
Jul 25 10:00:40 user nova-compute[71312]:         <nova:user uuid="c2cfdced66e34e0ba7f9437e71aaee6a">tempest-ServerActionsTestOtherA-408585031-project-member</nova:user>
Jul 25 10:00:40 user nova-compute[71312]:         <nova:project uuid="9c30d33a1a8945fdab6798c94a558444">tempest-ServerActionsTestOtherA-408585031</nova:project>
Jul 25 10:00:40 user nova-compute[71312]:       </nova:owner>
Jul 25 10:00:40 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:00:40 user nova-compute[71312]:       <nova:ports>
Jul 25 10:00:40 user nova-compute[71312]:         <nova:port uuid="d1cb436a-ed84-43ea-a32f-6c08effc60d6">
Jul 25 10:00:40 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 10:00:40 user nova-compute[71312]:         </nova:port>
Jul 25 10:00:40 user nova-compute[71312]:       </nova:ports>
Jul 25 10:00:40 user nova-compute[71312]:     </nova:instance>
Jul 25 10:00:40 user nova-compute[71312]:   </metadata>
Jul 25 10:00:40 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:00:40 user nova-compute[71312]:     <system>
Jul 25 10:00:40 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:00:40 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:00:40 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:00:40 user nova-compute[71312]:       <entry name="serial">bcc93774-32b0-4592-bf6a-d655bac21d39</entry>
Jul 25 10:00:40 user nova-compute[71312]:       <entry name="uuid">bcc93774-32b0-4592-bf6a-d655bac21d39</entry>
Jul 25 10:00:40 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:00:40 user nova-compute[71312]:     </system>
Jul 25 10:00:40 user nova-compute[71312]:   </sysinfo>
Jul 25 10:00:40 user nova-compute[71312]:   <os>
Jul 25 10:00:40 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:00:40 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:00:40 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:00:40 user nova-compute[71312]:   </os>
Jul 25 10:00:40 user nova-compute[71312]:   <features>
Jul 25 10:00:40 user nova-compute[71312]:     <acpi/>
Jul 25 10:00:40 user nova-compute[71312]:     <apic/>
Jul 25 10:00:40 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:00:40 user nova-compute[71312]:   </features>
Jul 25 10:00:40 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:00:40 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:00:40 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:00:40 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:00:40 user nova-compute[71312]:   </clock>
Jul 25 10:00:40 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:00:40 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:00:40 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:00:40 user nova-compute[71312]:   </cpu>
Jul 25 10:00:40 user nova-compute[71312]:   <devices>
Jul 25 10:00:40 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:00:40 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:00:40 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk"/>
Jul 25 10:00:40 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:00:40 user nova-compute[71312]:     </disk>
Jul 25 10:00:40 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:00:40 user nova-compute[71312]:       <mac address="fa:16:3e:e9:8e:2b"/>
Jul 25 10:00:40 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:40 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:00:40 user nova-compute[71312]:       <target dev="tapd1cb436a-ed"/>
Jul 25 10:00:40 user nova-compute[71312]:     </interface>
Jul 25 10:00:40 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:00:40 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/console.log" append="off"/>
Jul 25 10:00:40 user nova-compute[71312]:     </serial>
Jul 25 10:00:40 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:00:40 user nova-compute[71312]:     <video>
Jul 25 10:00:40 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:40 user nova-compute[71312]:     </video>
Jul 25 10:00:40 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:00:40 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:00:40 user nova-compute[71312]:     </rng>
Jul 25 10:00:40 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:00:40 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:00:40 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:00:40 user nova-compute[71312]:     </memballoon>
Jul 25 10:00:40 user nova-compute[71312]:   </devices>
Jul 25 10:00:40 user nova-compute[71312]: </domain>
Jul 25 10:00:40 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-164940161',display_name='tempest-ServerActionsTestOtherA-server-164940161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-164940161',id=5,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7/PiN27E1zNONLGfU75gjTzl6TjLJTSPguo/w/NLGiNWvcFBQAXJk/RsZr2x3/TDzaN8UL9NG26qh75+qbwT35akc6FqjZaWZn3poJMiar+SGmPPXZDxAQP/CqYmNQIw==',key_name='tempest-keypair-2143034637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c30d33a1a8945fdab6798c94a558444',ramdisk_id='',reservation_id='r-rxkl8cmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-408585031',owner_user_name='tempest-ServerActionsTestOtherA-408585031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfdced66e34e0ba7f9437e71aaee6a',uuid=bcc93774-32b0-4592-bf6a-d655bac21d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converting VIF {"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=d1cb436a-ed84-43ea-a32f-6c08effc60d6,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb436a-ed') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG os_vif [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=d1cb436a-ed84-43ea-a32f-6c08effc60d6,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb436a-ed') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk 1073741824" returned: 0 in 0.074s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1cb436a-ed, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1cb436a-ed, col_values=(('external_ids', {'iface-id': 'd1cb436a-ed84-43ea-a32f-6c08effc60d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:8e:2b', 'vm-uuid': 'bcc93774-32b0-4592-bf6a-d655bac21d39'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:40 user nova-compute[71312]: INFO os_vif [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=d1cb436a-ed84-43ea-a32f-6c08effc60d6,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb436a-ed')
Jul 25 10:00:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Successfully created port: bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] No VIF found with MAC fa:16:3e:e9:8e:2b, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Cannot resize image /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lazy-loading 'migration_context' on Instance uuid cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Ensure instance console log exists: /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-faa21885-228f-4e8a-b118-6158c9bd8bad req-10e2eb8d-f142-4a26-86dc-88313003a54e service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-changed-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-faa21885-228f-4e8a-b118-6158c9bd8bad req-10e2eb8d-f142-4a26-86dc-88313003a54e service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Refreshing instance network info cache due to event network-changed-8727a126-c33f-4868-8651-45e7c1f663d2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-faa21885-228f-4e8a-b118-6158c9bd8bad req-10e2eb8d-f142-4a26-86dc-88313003a54e service nova] Acquiring lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-faa21885-228f-4e8a-b118-6158c9bd8bad req-10e2eb8d-f142-4a26-86dc-88313003a54e service nova] Acquired lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-faa21885-228f-4e8a-b118-6158c9bd8bad req-10e2eb8d-f142-4a26-86dc-88313003a54e service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Refreshing network info cache for port 8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-cd4ccd54-2e67-48fd-bb12-f078f7d6399a req-0f8bfdd7-06d6-493b-8dd1-2b199cff5f9e service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updated VIF entry in instance network info cache for port d1cb436a-ed84-43ea-a32f-6c08effc60d6. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-cd4ccd54-2e67-48fd-bb12-f078f7d6399a req-0f8bfdd7-06d6-493b-8dd1-2b199cff5f9e service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updating instance_info_cache with network_info: [{"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cd4ccd54-2e67-48fd-bb12-f078f7d6399a req-0f8bfdd7-06d6-493b-8dd1-2b199cff5f9e service nova] Releasing lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-d98c7810-cd98-4564-becf-2b1158096725 req-18045028-1c33-4ac6-bc0b-72de021b7acb service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Updated VIF entry in instance network info cache for port 6d07c46c-fbbc-4e54-9261-0cd213bbb4ca. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:00:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-d98c7810-cd98-4564-becf-2b1158096725 req-18045028-1c33-4ac6-bc0b-72de021b7acb service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Updating instance_info_cache with network_info: [{"id": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "address": "fa:16:3e:60:b3:44", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d07c46c-fb", "ovs_interfaceid": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d98c7810-cd98-4564-becf-2b1158096725 req-18045028-1c33-4ac6-bc0b-72de021b7acb service nova] Releasing lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-faa21885-228f-4e8a-b118-6158c9bd8bad req-10e2eb8d-f142-4a26-86dc-88313003a54e service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updated VIF entry in instance network info cache for port 8727a126-c33f-4868-8651-45e7c1f663d2. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:00:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-faa21885-228f-4e8a-b118-6158c9bd8bad req-10e2eb8d-f142-4a26-86dc-88313003a54e service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updating instance_info_cache with network_info: [{"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-faa21885-228f-4e8a-b118-6158c9bd8bad req-10e2eb8d-f142-4a26-86dc-88313003a54e service nova] Releasing lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:42 user nova-compute[71312]: DEBUG nova.network.neutron [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Successfully created port: 63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:00:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:42 user nova-compute[71312]: DEBUG nova.network.neutron [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Successfully updated port: bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:00:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "refresh_cache-297fe407-3797-4681-ba83-e0f296780d57" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquired lock "refresh_cache-297fe407-3797-4681-ba83-e0f296780d57" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:42 user nova-compute[71312]: DEBUG nova.network.neutron [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:00:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-7f3d3241-83f4-438f-a926-ec5403de6a47 req-e56573c2-5c79-4ccc-8b9f-e40481f1bc7f service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Received event network-changed-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-7f3d3241-83f4-438f-a926-ec5403de6a47 req-e56573c2-5c79-4ccc-8b9f-e40481f1bc7f service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Refreshing instance network info cache due to event network-changed-bf53ba3e-ce75-4c45-bdcf-0135e786ea67. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:00:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7f3d3241-83f4-438f-a926-ec5403de6a47 req-e56573c2-5c79-4ccc-8b9f-e40481f1bc7f service nova] Acquiring lock "refresh_cache-297fe407-3797-4681-ba83-e0f296780d57" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:43 user nova-compute[71312]: DEBUG nova.network.neutron [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:00:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:44 user nova-compute[71312]: DEBUG nova.network.neutron [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Updating instance_info_cache with network_info: [{"id": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "address": "fa:16:3e:ea:da:e0", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf53ba3e-ce", "ovs_interfaceid": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Releasing lock "refresh_cache-297fe407-3797-4681-ba83-e0f296780d57" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Instance network_info: |[{"id": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "address": "fa:16:3e:ea:da:e0", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf53ba3e-ce", "ovs_interfaceid": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:00:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7f3d3241-83f4-438f-a926-ec5403de6a47 req-e56573c2-5c79-4ccc-8b9f-e40481f1bc7f service nova] Acquired lock "refresh_cache-297fe407-3797-4681-ba83-e0f296780d57" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:44 user nova-compute[71312]: DEBUG nova.network.neutron [req-7f3d3241-83f4-438f-a926-ec5403de6a47 req-e56573c2-5c79-4ccc-8b9f-e40481f1bc7f service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Refreshing network info cache for port bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:00:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Start _get_guest_xml network_info=[{"id": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "address": "fa:16:3e:ea:da:e0", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf53ba3e-ce", "ovs_interfaceid": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:00:44 user nova-compute[71312]: DEBUG nova.network.neutron [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Successfully updated port: 63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:00:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-c069fcc5-f222-4292-94b8-9f4def1c9899 req-3086bc50-be75-4b2e-8cce-1d15e6d9d8a8 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-changed-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-c069fcc5-f222-4292-94b8-9f4def1c9899 req-3086bc50-be75-4b2e-8cce-1d15e6d9d8a8 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Refreshing instance network info cache due to event network-changed-63f89ec1-70e3-4e23-ad25-c0f935da374d. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:00:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c069fcc5-f222-4292-94b8-9f4def1c9899 req-3086bc50-be75-4b2e-8cce-1d15e6d9d8a8 service nova] Acquiring lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c069fcc5-f222-4292-94b8-9f4def1c9899 req-3086bc50-be75-4b2e-8cce-1d15e6d9d8a8 service nova] Acquired lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:44 user nova-compute[71312]: DEBUG nova.network.neutron [req-c069fcc5-f222-4292-94b8-9f4def1c9899 req-3086bc50-be75-4b2e-8cce-1d15e6d9d8a8 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Refreshing network info cache for port 63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:00:44 user nova-compute[71312]: DEBUG nova.network.neutron [req-c069fcc5-f222-4292-94b8-9f4def1c9899 req-3086bc50-be75-4b2e-8cce-1d15e6d9d8a8 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:00:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:45 user nova-compute[71312]: DEBUG nova.network.neutron [req-c069fcc5-f222-4292-94b8-9f4def1c9899 req-3086bc50-be75-4b2e-8cce-1d15e6d9d8a8 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c069fcc5-f222-4292-94b8-9f4def1c9899 req-3086bc50-be75-4b2e-8cce-1d15e6d9d8a8 service nova] Releasing lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquired lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:00:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:00:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-7f3d3241-83f4-438f-a926-ec5403de6a47 req-e56573c2-5c79-4ccc-8b9f-e40481f1bc7f service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Updated VIF entry in instance network info cache for port bf53ba3e-ce75-4c45-bdcf-0135e786ea67. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-7f3d3241-83f4-438f-a926-ec5403de6a47 req-e56573c2-5c79-4ccc-8b9f-e40481f1bc7f service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Updating instance_info_cache with network_info: [{"id": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "address": "fa:16:3e:ea:da:e0", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf53ba3e-ce", "ovs_interfaceid": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7f3d3241-83f4-438f-a926-ec5403de6a47 req-e56573c2-5c79-4ccc-8b9f-e40481f1bc7f service nova] Releasing lock "refresh_cache-297fe407-3797-4681-ba83-e0f296780d57" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Updating instance_info_cache with network_info: [{"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Releasing lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Instance network_info: |[{"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Start _get_guest_xml network_info=[{"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-62376243-90f6-4d24-b1a1-31e9a7442e7b req-bf9e5fc7-77f3-43ed-b38a-a506a61ce243 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-62376243-90f6-4d24-b1a1-31e9a7442e7b req-bf9e5fc7-77f3-43ed-b38a-a506a61ce243 service nova] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-62376243-90f6-4d24-b1a1-31e9a7442e7b req-bf9e5fc7-77f3-43ed-b38a-a506a61ce243 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-62376243-90f6-4d24-b1a1-31e9a7442e7b req-bf9e5fc7-77f3-43ed-b38a-a506a61ce243 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-62376243-90f6-4d24-b1a1-31e9a7442e7b req-bf9e5fc7-77f3-43ed-b38a-a506a61ce243 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] No waiting events found dispatching network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:00:46 user nova-compute[71312]: WARNING nova.compute.manager [req-62376243-90f6-4d24-b1a1-31e9a7442e7b req-bf9e5fc7-77f3-43ed-b38a-a506a61ce243 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received unexpected event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 for instance with vm_state building and task_state spawning.
Jul 25 10:00:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa76a991-259c-4f47-ad19-46dd72c48b04 req-52493b95-f0c0-4f89-807d-58a1befce9d3 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa76a991-259c-4f47-ad19-46dd72c48b04 req-52493b95-f0c0-4f89-807d-58a1befce9d3 service nova] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa76a991-259c-4f47-ad19-46dd72c48b04 req-52493b95-f0c0-4f89-807d-58a1befce9d3 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa76a991-259c-4f47-ad19-46dd72c48b04 req-52493b95-f0c0-4f89-807d-58a1befce9d3 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa76a991-259c-4f47-ad19-46dd72c48b04 req-52493b95-f0c0-4f89-807d-58a1befce9d3 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] No waiting events found dispatching network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:00:46 user nova-compute[71312]: WARNING nova.compute.manager [req-fa76a991-259c-4f47-ad19-46dd72c48b04 req-52493b95-f0c0-4f89-807d-58a1befce9d3 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received unexpected event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 for instance with vm_state building and task_state spawning.
Jul 25 10:00:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa76a991-259c-4f47-ad19-46dd72c48b04 req-52493b95-f0c0-4f89-807d-58a1befce9d3 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa76a991-259c-4f47-ad19-46dd72c48b04 req-52493b95-f0c0-4f89-807d-58a1befce9d3 service nova] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa76a991-259c-4f47-ad19-46dd72c48b04 req-52493b95-f0c0-4f89-807d-58a1befce9d3 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa76a991-259c-4f47-ad19-46dd72c48b04 req-52493b95-f0c0-4f89-807d-58a1befce9d3 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa76a991-259c-4f47-ad19-46dd72c48b04 req-52493b95-f0c0-4f89-807d-58a1befce9d3 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] No waiting events found dispatching network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:00:46 user nova-compute[71312]: WARNING nova.compute.manager [req-fa76a991-259c-4f47-ad19-46dd72c48b04 req-52493b95-f0c0-4f89-807d-58a1befce9d3 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received unexpected event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 for instance with vm_state building and task_state spawning.
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-639c5ea2-d63f-41de-9bbe-f4108eaef34b req-0c172f46-3d82-4683-9ba8-11f9720da363 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-639c5ea2-d63f-41de-9bbe-f4108eaef34b req-0c172f46-3d82-4683-9ba8-11f9720da363 service nova] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-639c5ea2-d63f-41de-9bbe-f4108eaef34b req-0c172f46-3d82-4683-9ba8-11f9720da363 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-639c5ea2-d63f-41de-9bbe-f4108eaef34b req-0c172f46-3d82-4683-9ba8-11f9720da363 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-639c5ea2-d63f-41de-9bbe-f4108eaef34b req-0c172f46-3d82-4683-9ba8-11f9720da363 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] No waiting events found dispatching network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:00:47 user nova-compute[71312]: WARNING nova.compute.manager [req-639c5ea2-d63f-41de-9bbe-f4108eaef34b req-0c172f46-3d82-4683-9ba8-11f9720da363 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received unexpected event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 for instance with vm_state building and task_state spawning.
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279247.8899717, 621e0aaf-d2c9-4269-9085-177fa5e1536b => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:00:47 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] VM Resumed (Lifecycle Event)
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:00:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Instance spawned successfully.
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:00:47 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:47 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:47 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:47 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:00:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1779173835',display_name='tempest-AttachVolumeNegativeTest-server-1779173835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1779173835',id=6,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCay/WI0FehBNmWmyo9/56LXZ2fXVFsUKftTqyrZn0/BNAzUBzOkXAJ0PX7gx0RbRaJ4cQ4VOqOfc86z63a3zWu10cWC818a9Fb4zxmYn6m0CnCT+MOdKWQ/tglCxVAVwA==',key_name='tempest-keypair-698565757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a09fcc394c945c2b843abf3df53cda6',ramdisk_id='',reservation_id='r-xi27xemv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016049404',owner_user_name='tempest-AttachVolumeNegativeTest-1016049404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe1a69013de4b4dbcb98a35e48d8ee8',uuid=297fe407-3797-4681-ba83-e0f296780d57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "address": "fa:16:3e:ea:da:e0", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf53ba3e-ce", "ovs_interfaceid": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converting VIF {"id": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "address": "fa:16:3e:ea:da:e0", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf53ba3e-ce", "ovs_interfaceid": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:da:e0,bridge_name='br-int',has_traffic_filtering=True,id=bf53ba3e-ce75-4c45-bdcf-0135e786ea67,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf53ba3e-ce') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.objects.instance [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'pci_devices' on Instance uuid 297fe407-3797-4681-ba83-e0f296780d57 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-154077661',display_name='tempest-ServerStableDeviceRescueTest-server-154077661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-154077661',id=7,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5DPaESDCeTpFbLJiK3piM5EU6CqyhywiQ6G6M7018kXvUoCeKIYBjx8qywJTsbdrwNXxHLDnFEpNN/Njz3QJ803HXAV1pUHCs8Upben7DXi3URXH+EDpuvsOogdBIbWA==',key_name='tempest-keypair-2033571811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda42819655247c4bd852a6e41edeb69',ramdisk_id='',reservation_id='r-vhaos4q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-430984902',owner_user_name='tempest-ServerStableDeviceRescueTest-430984902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e2c8d915c3f4fdd8056f8b8651a6b79',uuid=cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Converting VIF {"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:36:b8,bridge_name='br-int',has_traffic_filtering=True,id=63f89ec1-70e3-4e23-ad25-c0f935da374d,network=Network(ec35bc41-dfd0-49c6-a731-3d750841e2b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f89ec1-70') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.objects.instance [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lazy-loading 'pci_devices' on Instance uuid cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:00:48 user nova-compute[71312]:   <uuid>297fe407-3797-4681-ba83-e0f296780d57</uuid>
Jul 25 10:00:48 user nova-compute[71312]:   <name>instance-00000006</name>
Jul 25 10:00:48 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:00:48 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:00:48 user nova-compute[71312]:   <metadata>
Jul 25 10:00:48 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:00:48 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:00:48 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1779173835</nova:name>
Jul 25 10:00:48 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:00:47</nova:creationTime>
Jul 25 10:00:48 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:00:48 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:00:48 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:00:48 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:00:48 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:00:48 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:00:48 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:00:48 user nova-compute[71312]:       <nova:owner>
Jul 25 10:00:48 user nova-compute[71312]:         <nova:user uuid="3fe1a69013de4b4dbcb98a35e48d8ee8">tempest-AttachVolumeNegativeTest-1016049404-project-member</nova:user>
Jul 25 10:00:48 user nova-compute[71312]:         <nova:project uuid="0a09fcc394c945c2b843abf3df53cda6">tempest-AttachVolumeNegativeTest-1016049404</nova:project>
Jul 25 10:00:48 user nova-compute[71312]:       </nova:owner>
Jul 25 10:00:48 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:00:48 user nova-compute[71312]:       <nova:ports>
Jul 25 10:00:48 user nova-compute[71312]:         <nova:port uuid="bf53ba3e-ce75-4c45-bdcf-0135e786ea67">
Jul 25 10:00:48 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 25 10:00:48 user nova-compute[71312]:         </nova:port>
Jul 25 10:00:48 user nova-compute[71312]:       </nova:ports>
Jul 25 10:00:48 user nova-compute[71312]:     </nova:instance>
Jul 25 10:00:48 user nova-compute[71312]:   </metadata>
Jul 25 10:00:48 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:00:48 user nova-compute[71312]:     <system>
Jul 25 10:00:48 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:00:48 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:00:48 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:00:48 user nova-compute[71312]:       <entry name="serial">297fe407-3797-4681-ba83-e0f296780d57</entry>
Jul 25 10:00:48 user nova-compute[71312]:       <entry name="uuid">297fe407-3797-4681-ba83-e0f296780d57</entry>
Jul 25 10:00:48 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:00:48 user nova-compute[71312]:     </system>
Jul 25 10:00:48 user nova-compute[71312]:   </sysinfo>
Jul 25 10:00:48 user nova-compute[71312]:   <os>
Jul 25 10:00:48 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:00:48 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:00:48 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:00:48 user nova-compute[71312]:   </os>
Jul 25 10:00:48 user nova-compute[71312]:   <features>
Jul 25 10:00:48 user nova-compute[71312]:     <acpi/>
Jul 25 10:00:48 user nova-compute[71312]:     <apic/>
Jul 25 10:00:48 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:00:48 user nova-compute[71312]:   </features>
Jul 25 10:00:48 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:00:48 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:00:48 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:00:48 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:00:48 user nova-compute[71312]:   </clock>
Jul 25 10:00:48 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:00:48 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:00:48 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:00:48 user nova-compute[71312]:   </cpu>
Jul 25 10:00:48 user nova-compute[71312]:   <devices>
Jul 25 10:00:48 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:00:48 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:00:48 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk"/>
Jul 25 10:00:48 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:00:48 user nova-compute[71312]:     </disk>
Jul 25 10:00:48 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:00:48 user nova-compute[71312]:       <mac address="fa:16:3e:ea:da:e0"/>
Jul 25 10:00:48 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:48 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:00:48 user nova-compute[71312]:       <target dev="tapbf53ba3e-ce"/>
Jul 25 10:00:48 user nova-compute[71312]:     </interface>
Jul 25 10:00:48 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:00:48 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/console.log" append="off"/>
Jul 25 10:00:48 user nova-compute[71312]:     </serial>
Jul 25 10:00:48 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:00:48 user nova-compute[71312]:     <video>
Jul 25 10:00:48 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:48 user nova-compute[71312]:     </video>
Jul 25 10:00:48 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:00:48 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:00:48 user nova-compute[71312]:     </rng>
Jul 25 10:00:48 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:00:48 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:00:48 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:00:48 user nova-compute[71312]:     </memballoon>
Jul 25 10:00:48 user nova-compute[71312]:   </devices>
Jul 25 10:00:48 user nova-compute[71312]: </domain>
Jul 25 10:00:48 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1779173835',display_name='tempest-AttachVolumeNegativeTest-server-1779173835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1779173835',id=6,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCay/WI0FehBNmWmyo9/56LXZ2fXVFsUKftTqyrZn0/BNAzUBzOkXAJ0PX7gx0RbRaJ4cQ4VOqOfc86z63a3zWu10cWC818a9Fb4zxmYn6m0CnCT+MOdKWQ/tglCxVAVwA==',key_name='tempest-keypair-698565757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a09fcc394c945c2b843abf3df53cda6',ramdisk_id='',reservation_id='r-xi27xemv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016049404',owner_user_name='tempest-AttachVolumeNegativeTest-1016049404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe1a69013de4b4dbcb98a35e48d8ee8',uuid=297fe407-3797-4681-ba83-e0f296780d57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "address": "fa:16:3e:ea:da:e0", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf53ba3e-ce", "ovs_interfaceid": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converting VIF {"id": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "address": "fa:16:3e:ea:da:e0", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf53ba3e-ce", "ovs_interfaceid": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:da:e0,bridge_name='br-int',has_traffic_filtering=True,id=bf53ba3e-ce75-4c45-bdcf-0135e786ea67,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf53ba3e-ce') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG os_vif [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:da:e0,bridge_name='br-int',has_traffic_filtering=True,id=bf53ba3e-ce75-4c45-bdcf-0135e786ea67,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf53ba3e-ce') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:00:48 user nova-compute[71312]:   <uuid>cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1</uuid>
Jul 25 10:00:48 user nova-compute[71312]:   <name>instance-00000007</name>
Jul 25 10:00:48 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:00:48 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:00:48 user nova-compute[71312]:   <metadata>
Jul 25 10:00:48 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:00:48 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:00:48 user nova-compute[71312]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-154077661</nova:name>
Jul 25 10:00:48 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:00:47</nova:creationTime>
Jul 25 10:00:48 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:00:48 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:00:48 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:00:48 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:00:48 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:00:48 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:00:48 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:00:48 user nova-compute[71312]:       <nova:owner>
Jul 25 10:00:48 user nova-compute[71312]:         <nova:user uuid="9e2c8d915c3f4fdd8056f8b8651a6b79">tempest-ServerStableDeviceRescueTest-430984902-project-member</nova:user>
Jul 25 10:00:48 user nova-compute[71312]:         <nova:project uuid="dda42819655247c4bd852a6e41edeb69">tempest-ServerStableDeviceRescueTest-430984902</nova:project>
Jul 25 10:00:48 user nova-compute[71312]:       </nova:owner>
Jul 25 10:00:48 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:00:48 user nova-compute[71312]:       <nova:ports>
Jul 25 10:00:48 user nova-compute[71312]:         <nova:port uuid="63f89ec1-70e3-4e23-ad25-c0f935da374d">
Jul 25 10:00:48 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 10:00:48 user nova-compute[71312]:         </nova:port>
Jul 25 10:00:48 user nova-compute[71312]:       </nova:ports>
Jul 25 10:00:48 user nova-compute[71312]:     </nova:instance>
Jul 25 10:00:48 user nova-compute[71312]:   </metadata>
Jul 25 10:00:48 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:00:48 user nova-compute[71312]:     <system>
Jul 25 10:00:48 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:00:48 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:00:48 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:00:48 user nova-compute[71312]:       <entry name="serial">cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1</entry>
Jul 25 10:00:48 user nova-compute[71312]:       <entry name="uuid">cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1</entry>
Jul 25 10:00:48 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:00:48 user nova-compute[71312]:     </system>
Jul 25 10:00:48 user nova-compute[71312]:   </sysinfo>
Jul 25 10:00:48 user nova-compute[71312]:   <os>
Jul 25 10:00:48 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:00:48 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:00:48 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:00:48 user nova-compute[71312]:   </os>
Jul 25 10:00:48 user nova-compute[71312]:   <features>
Jul 25 10:00:48 user nova-compute[71312]:     <acpi/>
Jul 25 10:00:48 user nova-compute[71312]:     <apic/>
Jul 25 10:00:48 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:00:48 user nova-compute[71312]:   </features>
Jul 25 10:00:48 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:00:48 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:00:48 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:00:48 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:00:48 user nova-compute[71312]:   </clock>
Jul 25 10:00:48 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:00:48 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:00:48 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:00:48 user nova-compute[71312]:   </cpu>
Jul 25 10:00:48 user nova-compute[71312]:   <devices>
Jul 25 10:00:48 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:00:48 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:00:48 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk"/>
Jul 25 10:00:48 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:00:48 user nova-compute[71312]:     </disk>
Jul 25 10:00:48 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:00:48 user nova-compute[71312]:       <mac address="fa:16:3e:77:36:b8"/>
Jul 25 10:00:48 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:48 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:00:48 user nova-compute[71312]:       <target dev="tap63f89ec1-70"/>
Jul 25 10:00:48 user nova-compute[71312]:     </interface>
Jul 25 10:00:48 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:00:48 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/console.log" append="off"/>
Jul 25 10:00:48 user nova-compute[71312]:     </serial>
Jul 25 10:00:48 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:00:48 user nova-compute[71312]:     <video>
Jul 25 10:00:48 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:48 user nova-compute[71312]:     </video>
Jul 25 10:00:48 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:00:48 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:00:48 user nova-compute[71312]:     </rng>
Jul 25 10:00:48 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:00:48 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:00:48 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:00:48 user nova-compute[71312]:     </memballoon>
Jul 25 10:00:48 user nova-compute[71312]:   </devices>
Jul 25 10:00:48 user nova-compute[71312]: </domain>
Jul 25 10:00:48 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-154077661',display_name='tempest-ServerStableDeviceRescueTest-server-154077661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-154077661',id=7,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5DPaESDCeTpFbLJiK3piM5EU6CqyhywiQ6G6M7018kXvUoCeKIYBjx8qywJTsbdrwNXxHLDnFEpNN/Njz3QJ803HXAV1pUHCs8Upben7DXi3URXH+EDpuvsOogdBIbWA==',key_name='tempest-keypair-2033571811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda42819655247c4bd852a6e41edeb69',ramdisk_id='',reservation_id='r-vhaos4q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-430984902',owner_user_name='tempest-ServerStableDeviceRescueTest-430984902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e2c8d915c3f4fdd8056f8b8651a6b79',uuid=cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Converting VIF {"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:36:b8,bridge_name='br-int',has_traffic_filtering=True,id=63f89ec1-70e3-4e23-ad25-c0f935da374d,network=Network(ec35bc41-dfd0-49c6-a731-3d750841e2b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f89ec1-70') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG os_vif [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:36:b8,bridge_name='br-int',has_traffic_filtering=True,id=63f89ec1-70e3-4e23-ad25-c0f935da374d,network=Network(ec35bc41-dfd0-49c6-a731-3d750841e2b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f89ec1-70') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf53ba3e-ce, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf53ba3e-ce, col_values=(('external_ids', {'iface-id': 'bf53ba3e-ce75-4c45-bdcf-0135e786ea67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:da:e0', 'vm-uuid': '297fe407-3797-4681-ba83-e0f296780d57'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.compute.manager [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Took 18.17 seconds to spawn the instance on the hypervisor.
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:48 user nova-compute[71312]: INFO os_vif [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:da:e0,bridge_name='br-int',has_traffic_filtering=True,id=bf53ba3e-ce75-4c45-bdcf-0135e786ea67,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf53ba3e-ce')
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63f89ec1-70, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63f89ec1-70, col_values=(('external_ids', {'iface-id': '63f89ec1-70e3-4e23-ad25-c0f935da374d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:36:b8', 'vm-uuid': 'cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:48 user nova-compute[71312]: INFO os_vif [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:36:b8,bridge_name='br-int',has_traffic_filtering=True,id=63f89ec1-70e3-4e23-ad25-c0f935da374d,network=Network(ec35bc41-dfd0-49c6-a731-3d750841e2b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f89ec1-70')
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279247.894314, 621e0aaf-d2c9-4269-9085-177fa5e1536b => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] VM Started (Lifecycle Event)
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.compute.manager [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Took 19.92 seconds to build instance.
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No VIF found with MAC fa:16:3e:ea:da:e0, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5ef98ac1-2c62-41dc-9306-69298fb2cbda tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.092s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279248.4789193, 5823c859-058e-4b2f-91b0-0e4def11bebf => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] VM Resumed (Lifecycle Event)
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] No VIF found with MAC fa:16:3e:77:36:b8, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Instance spawned successfully.
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Instance spawned successfully.
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279248.479175, 5823c859-058e-4b2f-91b0-0e4def11bebf => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] VM Started (Lifecycle Event)
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-cf6146ca-9c5d-4e82-adbb-013dbab331da req-3f3ba394-f5be-4c4d-b9a8-5e5e38e23b81 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf6146ca-9c5d-4e82-adbb-013dbab331da req-3f3ba394-f5be-4c4d-b9a8-5e5e38e23b81 service nova] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf6146ca-9c5d-4e82-adbb-013dbab331da req-3f3ba394-f5be-4c4d-b9a8-5e5e38e23b81 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf6146ca-9c5d-4e82-adbb-013dbab331da req-3f3ba394-f5be-4c4d-b9a8-5e5e38e23b81 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-cf6146ca-9c5d-4e82-adbb-013dbab331da req-3f3ba394-f5be-4c4d-b9a8-5e5e38e23b81 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] No waiting events found dispatching network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:00:48 user nova-compute[71312]: WARNING nova.compute.manager [req-cf6146ca-9c5d-4e82-adbb-013dbab331da req-3f3ba394-f5be-4c4d-b9a8-5e5e38e23b81 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received unexpected event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 for instance with vm_state building and task_state spawning.
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279248.4868894, a35abe6a-0a8b-4eb2-8781-85b99539d1fc => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] VM Resumed (Lifecycle Event)
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-79962112-a22e-4afc-8292-cf44fe771975 req-70edd768-cead-4d0a-907f-3f3a4e036106 service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Received event network-vif-plugged-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-79962112-a22e-4afc-8292-cf44fe771975 req-70edd768-cead-4d0a-907f-3f3a4e036106 service nova] Acquiring lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-79962112-a22e-4afc-8292-cf44fe771975 req-70edd768-cead-4d0a-907f-3f3a4e036106 service nova] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-79962112-a22e-4afc-8292-cf44fe771975 req-70edd768-cead-4d0a-907f-3f3a4e036106 service nova] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-79962112-a22e-4afc-8292-cf44fe771975 req-70edd768-cead-4d0a-907f-3f3a4e036106 service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] No waiting events found dispatching network-vif-plugged-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:00:48 user nova-compute[71312]: WARNING nova.compute.manager [req-79962112-a22e-4afc-8292-cf44fe771975 req-70edd768-cead-4d0a-907f-3f3a4e036106 service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Received unexpected event network-vif-plugged-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca for instance with vm_state building and task_state spawning.
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-79962112-a22e-4afc-8292-cf44fe771975 req-70edd768-cead-4d0a-907f-3f3a4e036106 service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Received event network-vif-plugged-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-79962112-a22e-4afc-8292-cf44fe771975 req-70edd768-cead-4d0a-907f-3f3a4e036106 service nova] Acquiring lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-79962112-a22e-4afc-8292-cf44fe771975 req-70edd768-cead-4d0a-907f-3f3a4e036106 service nova] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-79962112-a22e-4afc-8292-cf44fe771975 req-70edd768-cead-4d0a-907f-3f3a4e036106 service nova] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-79962112-a22e-4afc-8292-cf44fe771975 req-70edd768-cead-4d0a-907f-3f3a4e036106 service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] No waiting events found dispatching network-vif-plugged-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:00:48 user nova-compute[71312]: WARNING nova.compute.manager [req-79962112-a22e-4afc-8292-cf44fe771975 req-70edd768-cead-4d0a-907f-3f3a4e036106 service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Received unexpected event network-vif-plugged-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca for instance with vm_state building and task_state spawning.
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.compute.manager [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Took 17.96 seconds to spawn the instance on the hypervisor.
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.compute.manager [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Took 19.97 seconds to spawn the instance on the hypervisor.
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279248.4955554, a35abe6a-0a8b-4eb2-8781-85b99539d1fc => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] VM Started (Lifecycle Event)
Jul 25 10:00:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Instance spawned successfully.
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:00:48 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Instance spawned successfully.
Jul 25 10:00:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:49 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279248.8338366, bcc93774-32b0-4592-bf6a-d655bac21d39 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:00:49 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] VM Resumed (Lifecycle Event)
Jul 25 10:00:49 user nova-compute[71312]: INFO nova.compute.manager [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Took 21.44 seconds to build instance.
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-3cf3fad2-9dc0-416d-b020-af390a366a01 req-ab4a1b30-00e3-4386-8c37-7cbe59b3ed12 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3cf3fad2-9dc0-416d-b020-af390a366a01 req-ab4a1b30-00e3-4386-8c37-7cbe59b3ed12 service nova] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3cf3fad2-9dc0-416d-b020-af390a366a01 req-ab4a1b30-00e3-4386-8c37-7cbe59b3ed12 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3cf3fad2-9dc0-416d-b020-af390a366a01 req-ab4a1b30-00e3-4386-8c37-7cbe59b3ed12 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-3cf3fad2-9dc0-416d-b020-af390a366a01 req-ab4a1b30-00e3-4386-8c37-7cbe59b3ed12 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] No waiting events found dispatching network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:00:49 user nova-compute[71312]: WARNING nova.compute.manager [req-3cf3fad2-9dc0-416d-b020-af390a366a01 req-ab4a1b30-00e3-4386-8c37-7cbe59b3ed12 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received unexpected event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 for instance with vm_state building and task_state spawning.
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-3cf3fad2-9dc0-416d-b020-af390a366a01 req-ab4a1b30-00e3-4386-8c37-7cbe59b3ed12 service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Received event network-vif-plugged-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3cf3fad2-9dc0-416d-b020-af390a366a01 req-ab4a1b30-00e3-4386-8c37-7cbe59b3ed12 service nova] Acquiring lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3cf3fad2-9dc0-416d-b020-af390a366a01 req-ab4a1b30-00e3-4386-8c37-7cbe59b3ed12 service nova] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3cf3fad2-9dc0-416d-b020-af390a366a01 req-ab4a1b30-00e3-4386-8c37-7cbe59b3ed12 service nova] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-3cf3fad2-9dc0-416d-b020-af390a366a01 req-ab4a1b30-00e3-4386-8c37-7cbe59b3ed12 service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] No waiting events found dispatching network-vif-plugged-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:00:49 user nova-compute[71312]: WARNING nova.compute.manager [req-3cf3fad2-9dc0-416d-b020-af390a366a01 req-ab4a1b30-00e3-4386-8c37-7cbe59b3ed12 service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Received unexpected event network-vif-plugged-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 for instance with vm_state active and task_state None.
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:00:49 user nova-compute[71312]: INFO nova.compute.manager [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Took 18.66 seconds to spawn the instance on the hypervisor.
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:49 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279248.8361769, bcc93774-32b0-4592-bf6a-d655bac21d39 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:00:49 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] VM Started (Lifecycle Event)
Jul 25 10:00:49 user nova-compute[71312]: INFO nova.compute.manager [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Took 19.64 seconds to build instance.
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd0c99c6-6ce6-4922-9233-494ead95df5c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.891s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:49 user nova-compute[71312]: INFO nova.compute.manager [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Took 14.79 seconds to spawn the instance on the hypervisor.
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ee57b0b-32c3-4c13-a823-182cf4f22a2a tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.840s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:00:49 user nova-compute[71312]: INFO nova.compute.manager [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Took 19.78 seconds to build instance.
Jul 25 10:00:49 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279248.8555868, 9fb85501-6210-4bfd-b496-1891c79fd23c => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:00:49 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] VM Resumed (Lifecycle Event)
Jul 25 10:00:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-122155b5-b062-44a6-b3f6-4df4710840fc tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.027s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:49 user nova-compute[71312]: INFO nova.compute.manager [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Took 15.74 seconds to build instance.
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279248.85867, 9fb85501-6210-4bfd-b496-1891c79fd23c => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:00:49 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] VM Started (Lifecycle Event)
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2c4ab85b-32ce-476c-8dbf-31e40a76d33c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.985s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "50f8683d-8b60-4095-9507-a969c37f85e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "50f8683d-8b60-4095-9507-a969c37f85e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:00:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:50 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:00:50 user nova-compute[71312]: INFO nova.compute.claims [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Claim successful on node user
Jul 25 10:00:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-6a01fd99-80e4-4cfe-963e-741a20498857 req-e65f3913-c48d-4372-8cd8-8eee65ae05af service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Received event network-vif-plugged-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6a01fd99-80e4-4cfe-963e-741a20498857 req-e65f3913-c48d-4372-8cd8-8eee65ae05af service nova] Acquiring lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6a01fd99-80e4-4cfe-963e-741a20498857 req-e65f3913-c48d-4372-8cd8-8eee65ae05af service nova] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6a01fd99-80e4-4cfe-963e-741a20498857 req-e65f3913-c48d-4372-8cd8-8eee65ae05af service nova] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-6a01fd99-80e4-4cfe-963e-741a20498857 req-e65f3913-c48d-4372-8cd8-8eee65ae05af service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] No waiting events found dispatching network-vif-plugged-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:00:51 user nova-compute[71312]: WARNING nova.compute.manager [req-6a01fd99-80e4-4cfe-963e-741a20498857 req-e65f3913-c48d-4372-8cd8-8eee65ae05af service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Received unexpected event network-vif-plugged-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 for instance with vm_state active and task_state None.
Jul 25 10:00:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:51 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:00:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:51 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:00:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.209s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:00:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:00:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:52 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:00:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-af909d20-59b3-43d7-9918-3feb25b8f39d req-56e06c6d-623f-41cc-95eb-ed85eb41ee0e service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Received event network-vif-plugged-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-af909d20-59b3-43d7-9918-3feb25b8f39d req-56e06c6d-623f-41cc-95eb-ed85eb41ee0e service nova] Acquiring lock "297fe407-3797-4681-ba83-e0f296780d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-af909d20-59b3-43d7-9918-3feb25b8f39d req-56e06c6d-623f-41cc-95eb-ed85eb41ee0e service nova] Lock "297fe407-3797-4681-ba83-e0f296780d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-af909d20-59b3-43d7-9918-3feb25b8f39d req-56e06c6d-623f-41cc-95eb-ed85eb41ee0e service nova] Lock "297fe407-3797-4681-ba83-e0f296780d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-af909d20-59b3-43d7-9918-3feb25b8f39d req-56e06c6d-623f-41cc-95eb-ed85eb41ee0e service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] No waiting events found dispatching network-vif-plugged-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:00:52 user nova-compute[71312]: WARNING nova.compute.manager [req-af909d20-59b3-43d7-9918-3feb25b8f39d req-56e06c6d-623f-41cc-95eb-ed85eb41ee0e service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Received unexpected event network-vif-plugged-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 for instance with vm_state building and task_state spawning.
Jul 25 10:00:52 user nova-compute[71312]: DEBUG nova.policy [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c34765a32ae4f2ba338aec6b2240683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95726128af5243deabbbdcd68c5ccdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:00:52 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Creating image(s)
Jul 25 10:00:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "/opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "/opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "/opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.272s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.357s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk 1073741824" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.519s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.317s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:53 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:00:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:00:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json" returned: 0 in 0.368s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:00:54 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Cannot resize image /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:00:54 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lazy-loading 'migration_context' on Instance uuid 50f8683d-8b60-4095-9507-a969c37f85e2 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:00:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Ensure instance console log exists: /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:00:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-827ebc3c-2c74-4aec-a2da-02d815d44242 req-a22392cb-e5aa-49cb-99ba-079e5def98ff service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Received event network-vif-plugged-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-827ebc3c-2c74-4aec-a2da-02d815d44242 req-a22392cb-e5aa-49cb-99ba-079e5def98ff service nova] Acquiring lock "297fe407-3797-4681-ba83-e0f296780d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-827ebc3c-2c74-4aec-a2da-02d815d44242 req-a22392cb-e5aa-49cb-99ba-079e5def98ff service nova] Lock "297fe407-3797-4681-ba83-e0f296780d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-827ebc3c-2c74-4aec-a2da-02d815d44242 req-a22392cb-e5aa-49cb-99ba-079e5def98ff service nova] Lock "297fe407-3797-4681-ba83-e0f296780d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-827ebc3c-2c74-4aec-a2da-02d815d44242 req-a22392cb-e5aa-49cb-99ba-079e5def98ff service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] No waiting events found dispatching network-vif-plugged-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:00:54 user nova-compute[71312]: WARNING nova.compute.manager [req-827ebc3c-2c74-4aec-a2da-02d815d44242 req-a22392cb-e5aa-49cb-99ba-079e5def98ff service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Received unexpected event network-vif-plugged-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 for instance with vm_state building and task_state spawning.
Jul 25 10:00:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:55 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Successfully created port: 0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279256.4704862, cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:00:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] VM Resumed (Lifecycle Event)
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:56 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Instance spawned successfully.
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:00:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279256.4719145, cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:00:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] VM Started (Lifecycle Event)
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-8648dd00-e2d7-479d-b38b-5aecef9eee2a req-67ee2eff-3d01-4af8-801f-159f7766b905 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8648dd00-e2d7-479d-b38b-5aecef9eee2a req-67ee2eff-3d01-4af8-801f-159f7766b905 service nova] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8648dd00-e2d7-479d-b38b-5aecef9eee2a req-67ee2eff-3d01-4af8-801f-159f7766b905 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8648dd00-e2d7-479d-b38b-5aecef9eee2a req-67ee2eff-3d01-4af8-801f-159f7766b905 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-8648dd00-e2d7-479d-b38b-5aecef9eee2a req-67ee2eff-3d01-4af8-801f-159f7766b905 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] No waiting events found dispatching network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:00:56 user nova-compute[71312]: WARNING nova.compute.manager [req-8648dd00-e2d7-479d-b38b-5aecef9eee2a req-67ee2eff-3d01-4af8-801f-159f7766b905 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received unexpected event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d for instance with vm_state building and task_state spawning.
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-8648dd00-e2d7-479d-b38b-5aecef9eee2a req-67ee2eff-3d01-4af8-801f-159f7766b905 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8648dd00-e2d7-479d-b38b-5aecef9eee2a req-67ee2eff-3d01-4af8-801f-159f7766b905 service nova] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8648dd00-e2d7-479d-b38b-5aecef9eee2a req-67ee2eff-3d01-4af8-801f-159f7766b905 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8648dd00-e2d7-479d-b38b-5aecef9eee2a req-67ee2eff-3d01-4af8-801f-159f7766b905 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-8648dd00-e2d7-479d-b38b-5aecef9eee2a req-67ee2eff-3d01-4af8-801f-159f7766b905 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] No waiting events found dispatching network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:00:56 user nova-compute[71312]: WARNING nova.compute.manager [req-8648dd00-e2d7-479d-b38b-5aecef9eee2a req-67ee2eff-3d01-4af8-801f-159f7766b905 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received unexpected event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d for instance with vm_state building and task_state spawning.
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:00:56 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Instance spawned successfully.
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:00:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279256.7820835, 297fe407-3797-4681-ba83-e0f296780d57 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:00:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 297fe407-3797-4681-ba83-e0f296780d57] VM Resumed (Lifecycle Event)
Jul 25 10:00:56 user nova-compute[71312]: INFO nova.compute.manager [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Took 17.28 seconds to spawn the instance on the hypervisor.
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:00:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:00:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Successfully updated port: 0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:00:57 user nova-compute[71312]: INFO nova.compute.manager [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Took 18.38 seconds to build instance.
Jul 25 10:00:57 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 297fe407-3797-4681-ba83-e0f296780d57] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:00:57 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279256.7965984, 297fe407-3797-4681-ba83-e0f296780d57 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:00:57 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 297fe407-3797-4681-ba83-e0f296780d57] VM Started (Lifecycle Event)
Jul 25 10:00:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04e0b1c5-76dc-4e37-9c0b-f90e99809731 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.678s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "refresh_cache-50f8683d-8b60-4095-9507-a969c37f85e2" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquired lock "refresh_cache-50f8683d-8b60-4095-9507-a969c37f85e2" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:00:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:57 user nova-compute[71312]: INFO nova.compute.manager [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Took 18.75 seconds to spawn the instance on the hypervisor.
Jul 25 10:00:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:00:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:00:57 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 297fe407-3797-4681-ba83-e0f296780d57] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:00:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:00:57 user nova-compute[71312]: INFO nova.compute.manager [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Took 20.06 seconds to build instance.
Jul 25 10:00:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-27cfcb65-cd3a-4f7d-87bd-613c582ac2d0 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "297fe407-3797-4681-ba83-e0f296780d57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.178s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:00:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Updating instance_info_cache with network_info: [{"id": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "address": "fa:16:3e:5d:33:72", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643c7ae-df", "ovs_interfaceid": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Releasing lock "refresh_cache-50f8683d-8b60-4095-9507-a969c37f85e2" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Instance network_info: |[{"id": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "address": "fa:16:3e:5d:33:72", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643c7ae-df", "ovs_interfaceid": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Start _get_guest_xml network_info=[{"id": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "address": "fa:16:3e:5d:33:72", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643c7ae-df", "ovs_interfaceid": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:00:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-986570150',display_name='tempest-VolumesAdminNegativeTest-server-986570150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-986570150',id=8,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+siUtbUz/gIwAYoEssSRmdxmJ/sTqkWRHqIiQ4uLGIeEbodFp4HCnBENPOGH+Gqkhyq1MRG/BStmdBjspJLBxXUckt7DnkkNFUpjJc6XoQ7xU0c0CrylA6PTT1hyzsNA==',key_name='tempest-keypair-62837061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95726128af5243deabbbdcd68c5ccdcb',ramdisk_id='',reservation_id='r-qi90eq27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-692637044',owner_user_name='tempest-VolumesAdminNegativeTest-692637044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c34765a32ae4f2ba338aec6b2240683',uuid=50f8683d-8b60-4095-9507-a969c37f85e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "address": "fa:16:3e:5d:33:72", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643c7ae-df", "ovs_interfaceid": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Converting VIF {"id": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "address": "fa:16:3e:5d:33:72", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643c7ae-df", "ovs_interfaceid": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:33:72,bridge_name='br-int',has_traffic_filtering=True,id=0643c7ae-df24-43ff-8a02-2d4bd1f1cb39,network=Network(b77e8256-729d-45ef-9624-d10cebfb647a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0643c7ae-df') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lazy-loading 'pci_devices' on Instance uuid 50f8683d-8b60-4095-9507-a969c37f85e2 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:00:58 user nova-compute[71312]:   <uuid>50f8683d-8b60-4095-9507-a969c37f85e2</uuid>
Jul 25 10:00:58 user nova-compute[71312]:   <name>instance-00000008</name>
Jul 25 10:00:58 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:00:58 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:00:58 user nova-compute[71312]:   <metadata>
Jul 25 10:00:58 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:00:58 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:00:58 user nova-compute[71312]:       <nova:name>tempest-VolumesAdminNegativeTest-server-986570150</nova:name>
Jul 25 10:00:58 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:00:58</nova:creationTime>
Jul 25 10:00:58 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:00:58 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:00:58 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:00:58 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:00:58 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:00:58 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:00:58 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:00:58 user nova-compute[71312]:       <nova:owner>
Jul 25 10:00:58 user nova-compute[71312]:         <nova:user uuid="2c34765a32ae4f2ba338aec6b2240683">tempest-VolumesAdminNegativeTest-692637044-project-member</nova:user>
Jul 25 10:00:58 user nova-compute[71312]:         <nova:project uuid="95726128af5243deabbbdcd68c5ccdcb">tempest-VolumesAdminNegativeTest-692637044</nova:project>
Jul 25 10:00:58 user nova-compute[71312]:       </nova:owner>
Jul 25 10:00:58 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:00:58 user nova-compute[71312]:       <nova:ports>
Jul 25 10:00:58 user nova-compute[71312]:         <nova:port uuid="0643c7ae-df24-43ff-8a02-2d4bd1f1cb39">
Jul 25 10:00:58 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 10:00:58 user nova-compute[71312]:         </nova:port>
Jul 25 10:00:58 user nova-compute[71312]:       </nova:ports>
Jul 25 10:00:58 user nova-compute[71312]:     </nova:instance>
Jul 25 10:00:58 user nova-compute[71312]:   </metadata>
Jul 25 10:00:58 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:00:58 user nova-compute[71312]:     <system>
Jul 25 10:00:58 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:00:58 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:00:58 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:00:58 user nova-compute[71312]:       <entry name="serial">50f8683d-8b60-4095-9507-a969c37f85e2</entry>
Jul 25 10:00:58 user nova-compute[71312]:       <entry name="uuid">50f8683d-8b60-4095-9507-a969c37f85e2</entry>
Jul 25 10:00:58 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:00:58 user nova-compute[71312]:     </system>
Jul 25 10:00:58 user nova-compute[71312]:   </sysinfo>
Jul 25 10:00:58 user nova-compute[71312]:   <os>
Jul 25 10:00:58 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:00:58 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:00:58 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:00:58 user nova-compute[71312]:   </os>
Jul 25 10:00:58 user nova-compute[71312]:   <features>
Jul 25 10:00:58 user nova-compute[71312]:     <acpi/>
Jul 25 10:00:58 user nova-compute[71312]:     <apic/>
Jul 25 10:00:58 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:00:58 user nova-compute[71312]:   </features>
Jul 25 10:00:58 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:00:58 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:00:58 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:00:58 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:00:58 user nova-compute[71312]:   </clock>
Jul 25 10:00:58 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:00:58 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:00:58 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:00:58 user nova-compute[71312]:   </cpu>
Jul 25 10:00:58 user nova-compute[71312]:   <devices>
Jul 25 10:00:58 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:00:58 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:00:58 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk"/>
Jul 25 10:00:58 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:00:58 user nova-compute[71312]:     </disk>
Jul 25 10:00:58 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:00:58 user nova-compute[71312]:       <mac address="fa:16:3e:5d:33:72"/>
Jul 25 10:00:58 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:58 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:00:58 user nova-compute[71312]:       <target dev="tap0643c7ae-df"/>
Jul 25 10:00:58 user nova-compute[71312]:     </interface>
Jul 25 10:00:58 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:00:58 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/console.log" append="off"/>
Jul 25 10:00:58 user nova-compute[71312]:     </serial>
Jul 25 10:00:58 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:00:58 user nova-compute[71312]:     <video>
Jul 25 10:00:58 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:00:58 user nova-compute[71312]:     </video>
Jul 25 10:00:58 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:00:58 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:00:58 user nova-compute[71312]:     </rng>
Jul 25 10:00:58 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:00:58 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:00:58 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:00:58 user nova-compute[71312]:     </memballoon>
Jul 25 10:00:58 user nova-compute[71312]:   </devices>
Jul 25 10:00:58 user nova-compute[71312]: </domain>
Jul 25 10:00:58 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-986570150',display_name='tempest-VolumesAdminNegativeTest-server-986570150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-986570150',id=8,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+siUtbUz/gIwAYoEssSRmdxmJ/sTqkWRHqIiQ4uLGIeEbodFp4HCnBENPOGH+Gqkhyq1MRG/BStmdBjspJLBxXUckt7DnkkNFUpjJc6XoQ7xU0c0CrylA6PTT1hyzsNA==',key_name='tempest-keypair-62837061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95726128af5243deabbbdcd68c5ccdcb',ramdisk_id='',reservation_id='r-qi90eq27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-692637044',owner_user_name='tempest-VolumesAdminNegativeTest-692637044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:00:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c34765a32ae4f2ba338aec6b2240683',uuid=50f8683d-8b60-4095-9507-a969c37f85e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "address": "fa:16:3e:5d:33:72", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643c7ae-df", "ovs_interfaceid": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Converting VIF {"id": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "address": "fa:16:3e:5d:33:72", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643c7ae-df", "ovs_interfaceid": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:33:72,bridge_name='br-int',has_traffic_filtering=True,id=0643c7ae-df24-43ff-8a02-2d4bd1f1cb39,network=Network(b77e8256-729d-45ef-9624-d10cebfb647a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0643c7ae-df') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG os_vif [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:33:72,bridge_name='br-int',has_traffic_filtering=True,id=0643c7ae-df24-43ff-8a02-2d4bd1f1cb39,network=Network(b77e8256-729d-45ef-9624-d10cebfb647a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0643c7ae-df') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0643c7ae-df, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0643c7ae-df, col_values=(('external_ids', {'iface-id': '0643c7ae-df24-43ff-8a02-2d4bd1f1cb39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:33:72', 'vm-uuid': '50f8683d-8b60-4095-9507-a969c37f85e2'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:58 user nova-compute[71312]: INFO os_vif [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:33:72,bridge_name='br-int',has_traffic_filtering=True,id=0643c7ae-df24-43ff-8a02-2d4bd1f1cb39,network=Network(b77e8256-729d-45ef-9624-d10cebfb647a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0643c7ae-df')
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] No VIF found with MAC fa:16:3e:5d:33:72, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-043c781a-eccf-43fe-907c-f2bc0c30dbca req-09cfde5d-b875-4b94-a1a0-5dfb35cf10a0 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Received event network-changed-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-043c781a-eccf-43fe-907c-f2bc0c30dbca req-09cfde5d-b875-4b94-a1a0-5dfb35cf10a0 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Refreshing instance network info cache due to event network-changed-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-043c781a-eccf-43fe-907c-f2bc0c30dbca req-09cfde5d-b875-4b94-a1a0-5dfb35cf10a0 service nova] Acquiring lock "refresh_cache-50f8683d-8b60-4095-9507-a969c37f85e2" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-043c781a-eccf-43fe-907c-f2bc0c30dbca req-09cfde5d-b875-4b94-a1a0-5dfb35cf10a0 service nova] Acquired lock "refresh_cache-50f8683d-8b60-4095-9507-a969c37f85e2" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG nova.network.neutron [req-043c781a-eccf-43fe-907c-f2bc0c30dbca req-09cfde5d-b875-4b94-a1a0-5dfb35cf10a0 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Refreshing network info cache for port 0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:00:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:00:59 user nova-compute[71312]: DEBUG nova.network.neutron [req-043c781a-eccf-43fe-907c-f2bc0c30dbca req-09cfde5d-b875-4b94-a1a0-5dfb35cf10a0 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Updated VIF entry in instance network info cache for port 0643c7ae-df24-43ff-8a02-2d4bd1f1cb39. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:00:59 user nova-compute[71312]: DEBUG nova.network.neutron [req-043c781a-eccf-43fe-907c-f2bc0c30dbca req-09cfde5d-b875-4b94-a1a0-5dfb35cf10a0 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Updating instance_info_cache with network_info: [{"id": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "address": "fa:16:3e:5d:33:72", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643c7ae-df", "ovs_interfaceid": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:00:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-043c781a-eccf-43fe-907c-f2bc0c30dbca req-09cfde5d-b875-4b94-a1a0-5dfb35cf10a0 service nova] Releasing lock "refresh_cache-50f8683d-8b60-4095-9507-a969c37f85e2" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:01:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-27ba785f-b4b3-4057-94c4-db466df4fe81 req-103cdf83-3db0-43a8-8dd3-b339fd4dcb64 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Received event network-vif-plugged-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-27ba785f-b4b3-4057-94c4-db466df4fe81 req-103cdf83-3db0-43a8-8dd3-b339fd4dcb64 service nova] Acquiring lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-27ba785f-b4b3-4057-94c4-db466df4fe81 req-103cdf83-3db0-43a8-8dd3-b339fd4dcb64 service nova] Lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-27ba785f-b4b3-4057-94c4-db466df4fe81 req-103cdf83-3db0-43a8-8dd3-b339fd4dcb64 service nova] Lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-27ba785f-b4b3-4057-94c4-db466df4fe81 req-103cdf83-3db0-43a8-8dd3-b339fd4dcb64 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] No waiting events found dispatching network-vif-plugged-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:01:00 user nova-compute[71312]: WARNING nova.compute.manager [req-27ba785f-b4b3-4057-94c4-db466df4fe81 req-103cdf83-3db0-43a8-8dd3-b339fd4dcb64 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Received unexpected event network-vif-plugged-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 for instance with vm_state building and task_state spawning.
Jul 25 10:01:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:01:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:01:01 user nova-compute[71312]: INFO nova.compute.claims [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Claim successful on node user
Jul 25 10:01:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:02 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:01:02 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:01:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.712s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:01:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:01:02 user nova-compute[71312]: DEBUG nova.network.neutron [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:01:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:01:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:01:02 user nova-compute[71312]: DEBUG nova.policy [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6325c3b752a4cd88b584d9acd06d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5086ef6cce4cdfafc4a061ab06f894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:01:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:01:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:01:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Creating image(s)
Jul 25 10:01:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.187s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-8d7a379a-57eb-41cd-875a-38e1e1722ed6 req-8e0f5b02-7314-41f4-b59d-7c023eafc164 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Received event network-vif-plugged-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d7a379a-57eb-41cd-875a-38e1e1722ed6 req-8e0f5b02-7314-41f4-b59d-7c023eafc164 service nova] Acquiring lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d7a379a-57eb-41cd-875a-38e1e1722ed6 req-8e0f5b02-7314-41f4-b59d-7c023eafc164 service nova] Lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d7a379a-57eb-41cd-875a-38e1e1722ed6 req-8e0f5b02-7314-41f4-b59d-7c023eafc164 service nova] Lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-8d7a379a-57eb-41cd-875a-38e1e1722ed6 req-8e0f5b02-7314-41f4-b59d-7c023eafc164 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] No waiting events found dispatching network-vif-plugged-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:01:03 user nova-compute[71312]: WARNING nova.compute.manager [req-8d7a379a-57eb-41cd-875a-38e1e1722ed6 req-8e0f5b02-7314-41f4-b59d-7c023eafc164 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Received unexpected event network-vif-plugged-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 for instance with vm_state building and task_state spawning.
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.272s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk 1073741824" returned: 0 in 0.080s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279263.568803, 50f8683d-8b60-4095-9507-a969c37f85e2 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:01:03 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] VM Resumed (Lifecycle Event)
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:01:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Instance spawned successfully.
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.265s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:03 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279263.5792453, 50f8683d-8b60-4095-9507-a969c37f85e2 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:01:03 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] VM Started (Lifecycle Event)
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:01:03 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:01:03 user nova-compute[71312]: INFO nova.compute.manager [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Took 11.34 seconds to spawn the instance on the hypervisor.
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Cannot resize image /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.objects.instance [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lazy-loading 'migration_context' on Instance uuid c918b5d0-e8f8-40cc-9c25-71ea69d08756 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Ensure instance console log exists: /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:01:04 user nova-compute[71312]: DEBUG nova.network.neutron [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Successfully created port: 682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:01:04 user nova-compute[71312]: INFO nova.compute.manager [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Took 13.94 seconds to build instance.
Jul 25 10:01:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ed6af5ab-ad97-4310-b899-e6e8c922b4e8 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "50f8683d-8b60-4095-9507-a969c37f85e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.211s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:01:04 user nova-compute[71312]: INFO nova.compute.claims [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Claim successful on node user
Jul 25 10:01:04 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.778s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:01:05 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 25 10:01:05 user nova-compute[71312]: DEBUG nova.network.neutron [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Successfully updated port: 682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquired lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG nova.network.neutron [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-6bbfa39c-ba21-443e-a3bb-8d3e191caa2b req-0d556a07-c905-4337-af18-abef8d27d31e service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received event network-changed-682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-6bbfa39c-ba21-443e-a3bb-8d3e191caa2b req-0d556a07-c905-4337-af18-abef8d27d31e service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Refreshing instance network info cache due to event network-changed-682fce50-406a-4315-b5fc-b434a6c7c890. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6bbfa39c-ba21-443e-a3bb-8d3e191caa2b req-0d556a07-c905-4337-af18-abef8d27d31e service nova] Acquiring lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG nova.network.neutron [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG nova.policy [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6d67152f5984cfb97ced29a539956e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596d8ef54bf748bf8564c8be39d028ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:01:05 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Creating image(s)
Jul 25 10:01:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "/opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "/opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "5b816a569a10b167bc31bafc4d2824e7dd68ee82" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "5b816a569a10b167bc31bafc4d2824e7dd68ee82" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Updating instance_info_cache with network_info: [{"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Releasing lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Instance network_info: |[{"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6bbfa39c-ba21-443e-a3bb-8d3e191caa2b req-0d556a07-c905-4337-af18-abef8d27d31e service nova] Acquired lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.network.neutron [req-6bbfa39c-ba21-443e-a3bb-8d3e191caa2b req-0d556a07-c905-4337-af18-abef8d27d31e service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Refreshing network info cache for port 682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Start _get_guest_xml network_info=[{"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:01:06 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:01:06 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-282503515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-282503515',id=9,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfqLhAiM/fPqXox/lYYvHbsORMvG7EmhROMdWtJDW0gFjkybugS0JoPzqPg5A//Q1NyXk2q9pHeiid5wc4meqjPqIfzYlQ74CfLabiQCTkCNSfq5sY3vsH1zVkcnvVCvw==',key_name='tempest-keypair-791003982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b5086ef6cce4cdfafc4a061ab06f894',ramdisk_id='',reservation_id='r-g6z0fs1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1298550074',owner_user_name='tempest-TaggedAttachmentsTest-1298550074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6325c3b752a4cd88b584d9acd06d537',uuid=c918b5d0-e8f8-40cc-9c25-71ea69d08756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Converting VIF {"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=682fce50-406a-4315-b5fc-b434a6c7c890,network=Network(1555997f-e162-49c4-9513-24af3233ba3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682fce50-40') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lazy-loading 'pci_devices' on Instance uuid c918b5d0-e8f8-40cc-9c25-71ea69d08756 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82.part --force-share --output=json" returned: 0 in 0.308s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:01:06 user nova-compute[71312]:   <uuid>c918b5d0-e8f8-40cc-9c25-71ea69d08756</uuid>
Jul 25 10:01:06 user nova-compute[71312]:   <name>instance-00000009</name>
Jul 25 10:01:06 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:01:06 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:01:06 user nova-compute[71312]:   <metadata>
Jul 25 10:01:06 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:01:06 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:01:06 user nova-compute[71312]:       <nova:name>tempest-device-tagging-server-282503515</nova:name>
Jul 25 10:01:06 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:01:06</nova:creationTime>
Jul 25 10:01:06 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:01:06 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:01:06 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:01:06 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:01:06 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:01:06 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:01:06 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:01:06 user nova-compute[71312]:       <nova:owner>
Jul 25 10:01:06 user nova-compute[71312]:         <nova:user uuid="d6325c3b752a4cd88b584d9acd06d537">tempest-TaggedAttachmentsTest-1298550074-project-member</nova:user>
Jul 25 10:01:06 user nova-compute[71312]:         <nova:project uuid="5b5086ef6cce4cdfafc4a061ab06f894">tempest-TaggedAttachmentsTest-1298550074</nova:project>
Jul 25 10:01:06 user nova-compute[71312]:       </nova:owner>
Jul 25 10:01:06 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:01:06 user nova-compute[71312]:       <nova:ports>
Jul 25 10:01:06 user nova-compute[71312]:         <nova:port uuid="682fce50-406a-4315-b5fc-b434a6c7c890">
Jul 25 10:01:06 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:01:06 user nova-compute[71312]:         </nova:port>
Jul 25 10:01:06 user nova-compute[71312]:       </nova:ports>
Jul 25 10:01:06 user nova-compute[71312]:     </nova:instance>
Jul 25 10:01:06 user nova-compute[71312]:   </metadata>
Jul 25 10:01:06 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:01:06 user nova-compute[71312]:     <system>
Jul 25 10:01:06 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:01:06 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:01:06 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:01:06 user nova-compute[71312]:       <entry name="serial">c918b5d0-e8f8-40cc-9c25-71ea69d08756</entry>
Jul 25 10:01:06 user nova-compute[71312]:       <entry name="uuid">c918b5d0-e8f8-40cc-9c25-71ea69d08756</entry>
Jul 25 10:01:06 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:01:06 user nova-compute[71312]:     </system>
Jul 25 10:01:06 user nova-compute[71312]:   </sysinfo>
Jul 25 10:01:06 user nova-compute[71312]:   <os>
Jul 25 10:01:06 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:01:06 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:01:06 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:01:06 user nova-compute[71312]:   </os>
Jul 25 10:01:06 user nova-compute[71312]:   <features>
Jul 25 10:01:06 user nova-compute[71312]:     <acpi/>
Jul 25 10:01:06 user nova-compute[71312]:     <apic/>
Jul 25 10:01:06 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:01:06 user nova-compute[71312]:   </features>
Jul 25 10:01:06 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:01:06 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:01:06 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:01:06 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:01:06 user nova-compute[71312]:   </clock>
Jul 25 10:01:06 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:01:06 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:01:06 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:01:06 user nova-compute[71312]:   </cpu>
Jul 25 10:01:06 user nova-compute[71312]:   <devices>
Jul 25 10:01:06 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:01:06 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:01:06 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk"/>
Jul 25 10:01:06 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:01:06 user nova-compute[71312]:     </disk>
Jul 25 10:01:06 user nova-compute[71312]:     <disk type="file" device="cdrom">
Jul 25 10:01:06 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none"/>
Jul 25 10:01:06 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk.config"/>
Jul 25 10:01:06 user nova-compute[71312]:       <target dev="hda" bus="ide"/>
Jul 25 10:01:06 user nova-compute[71312]:     </disk>
Jul 25 10:01:06 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:01:06 user nova-compute[71312]:       <mac address="fa:16:3e:4a:96:ef"/>
Jul 25 10:01:06 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:01:06 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:01:06 user nova-compute[71312]:       <target dev="tap682fce50-40"/>
Jul 25 10:01:06 user nova-compute[71312]:     </interface>
Jul 25 10:01:06 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:01:06 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/console.log" append="off"/>
Jul 25 10:01:06 user nova-compute[71312]:     </serial>
Jul 25 10:01:06 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:01:06 user nova-compute[71312]:     <video>
Jul 25 10:01:06 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:01:06 user nova-compute[71312]:     </video>
Jul 25 10:01:06 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:01:06 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:01:06 user nova-compute[71312]:     </rng>
Jul 25 10:01:06 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:01:06 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:01:06 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:01:06 user nova-compute[71312]:     </memballoon>
Jul 25 10:01:06 user nova-compute[71312]:   </devices>
Jul 25 10:01:06 user nova-compute[71312]: </domain>
Jul 25 10:01:06 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-282503515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-282503515',id=9,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfqLhAiM/fPqXox/lYYvHbsORMvG7EmhROMdWtJDW0gFjkybugS0JoPzqPg5A//Q1NyXk2q9pHeiid5wc4meqjPqIfzYlQ74CfLabiQCTkCNSfq5sY3vsH1zVkcnvVCvw==',key_name='tempest-keypair-791003982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b5086ef6cce4cdfafc4a061ab06f894',ramdisk_id='',reservation_id='r-g6z0fs1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1298550074',owner_user_name='tempest-TaggedAttachmentsTest-1298550074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6325c3b752a4cd88b584d9acd06d537',uuid=c918b5d0-e8f8-40cc-9c25-71ea69d08756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Converting VIF {"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=682fce50-406a-4315-b5fc-b434a6c7c890,network=Network(1555997f-e162-49c4-9513-24af3233ba3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682fce50-40') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG os_vif [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=682fce50-406a-4315-b5fc-b434a6c7c890,network=Network(1555997f-e162-49c4-9513-24af3233ba3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682fce50-40') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.virt.images [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] 688e4d28-2f51-4eeb-a136-06b40da73ac0 was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82.part /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap682fce50-40, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap682fce50-40, col_values=(('external_ids', {'iface-id': '682fce50-406a-4315-b5fc-b434a6c7c890', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:96:ef', 'vm-uuid': 'c918b5d0-e8f8-40cc-9c25-71ea69d08756'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Successfully created port: 1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:01:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:06 user nova-compute[71312]: INFO os_vif [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=682fce50-406a-4315-b5fc-b434a6c7c890,network=Network(1555997f-e162-49c4-9513-24af3233ba3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682fce50-40')
Jul 25 10:01:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] No BDM found with device name hda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] No VIF found with MAC fa:16:3e:4a:96:ef, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:01:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Using config drive
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82.part /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82.converted" returned: 0 in 0.277s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82.converted --force-share --output=json" returned: 0 in 0.232s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "5b816a569a10b167bc31bafc4d2824e7dd68ee82" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.734s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-6bbfa39c-ba21-443e-a3bb-8d3e191caa2b req-0d556a07-c905-4337-af18-abef8d27d31e service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Updated VIF entry in instance network info cache for port 682fce50-406a-4315-b5fc-b434a6c7c890. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-6bbfa39c-ba21-443e-a3bb-8d3e191caa2b req-0d556a07-c905-4337-af18-abef8d27d31e service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Updating instance_info_cache with network_info: [{"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6bbfa39c-ba21-443e-a3bb-8d3e191caa2b req-0d556a07-c905-4337-af18-abef8d27d31e service nova] Releasing lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82 --force-share --output=json" returned: 0 in 0.201s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "5b816a569a10b167bc31bafc4d2824e7dd68ee82" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "5b816a569a10b167bc31bafc4d2824e7dd68ee82" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Creating config drive at /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk.config
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzb2gorm6 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82 --force-share --output=json" returned: 0 in 0.203s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82,backing_fmt=raw /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzb2gorm6" returned: 0 in 0.074s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82,backing_fmt=raw /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk 1073741824" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "5b816a569a10b167bc31bafc4d2824e7dd68ee82" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82 --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Cannot resize image /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lazy-loading 'migration_context' on Instance uuid d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Ensure instance console log exists: /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Successfully updated port: 1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "refresh_cache-d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquired lock "refresh_cache-d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-0fd9c01f-1f7b-4d15-8fa7-04fe312b98c4 req-45f38a26-ba8c-4ae0-809b-3806db94de07 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Received event network-changed-1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-0fd9c01f-1f7b-4d15-8fa7-04fe312b98c4 req-45f38a26-ba8c-4ae0-809b-3806db94de07 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Refreshing instance network info cache due to event network-changed-1022b294-bd18-485e-a79a-25d9a11b6e42. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0fd9c01f-1f7b-4d15-8fa7-04fe312b98c4 req-45f38a26-ba8c-4ae0-809b-3806db94de07 service nova] Acquiring lock "refresh_cache-d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:01:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Updating instance_info_cache with network_info: [{"id": "1022b294-bd18-485e-a79a-25d9a11b6e42", "address": "fa:16:3e:e2:13:bd", "network": {"id": "0cebbe11-b08a-472b-b7d3-db59047dabfd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-202502212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "596d8ef54bf748bf8564c8be39d028ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1022b294-bd", "ovs_interfaceid": "1022b294-bd18-485e-a79a-25d9a11b6e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Releasing lock "refresh_cache-d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Instance network_info: |[{"id": "1022b294-bd18-485e-a79a-25d9a11b6e42", "address": "fa:16:3e:e2:13:bd", "network": {"id": "0cebbe11-b08a-472b-b7d3-db59047dabfd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-202502212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "596d8ef54bf748bf8564c8be39d028ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1022b294-bd", "ovs_interfaceid": "1022b294-bd18-485e-a79a-25d9a11b6e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0fd9c01f-1f7b-4d15-8fa7-04fe312b98c4 req-45f38a26-ba8c-4ae0-809b-3806db94de07 service nova] Acquired lock "refresh_cache-d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-0fd9c01f-1f7b-4d15-8fa7-04fe312b98c4 req-45f38a26-ba8c-4ae0-809b-3806db94de07 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Refreshing network info cache for port 1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Start _get_guest_xml network_info=[{"id": "1022b294-bd18-485e-a79a-25d9a11b6e42", "address": "fa:16:3e:e2:13:bd", "network": {"id": "0cebbe11-b08a-472b-b7d3-db59047dabfd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-202502212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "596d8ef54bf748bf8564c8be39d028ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1022b294-bd", "ovs_interfaceid": "1022b294-bd18-485e-a79a-25d9a11b6e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T10:00:53Z,direct_url=<?>,disk_format='qcow2',id=688e4d28-2f51-4eeb-a136-06b40da73ac0,min_disk=0,min_ram=0,name='',owner='f9ce473a0002493ab40f13182bd4dea1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T10:00:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'scsi', 'encryption_format': None, 'device_name': '/dev/sda', 'image_id': '688e4d28-2f51-4eeb-a136-06b40da73ac0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:01:09 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:01:09 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T10:00:53Z,direct_url=<?>,disk_format='qcow2',id=688e4d28-2f51-4eeb-a136-06b40da73ac0,min_disk=0,min_ram=0,name='',owner='f9ce473a0002493ab40f13182bd4dea1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T10:00:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1357350949',display_name='tempest-AttachSCSIVolumeTestJSON-server-1357350949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1357350949',id=10,image_ref='688e4d28-2f51-4eeb-a136-06b40da73ac0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXEA+71avj89VbYClk00a8HT4J+zXMYN9DdWA6hh8jWaZSg9IkLIXSSWMqfWLeqbEP7IDChHSl3HAxapVcYmIWnM7WL4HgwsM62s/SPxNBVsff7wSlV3XoC0/rv0xlZIw==',key_name='tempest-keypair-838100764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='596d8ef54bf748bf8564c8be39d028ff',ramdisk_id='',reservation_id='r-8mm9djqj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='688e4d28-2f51-4eeb-a136-06b40da73ac0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1704055171',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1704055171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6d67152f5984cfb97ced29a539956e6',uuid=d5af1891-6ce7-408d-9f4d-9c5ecfe601b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1022b294-bd18-485e-a79a-25d9a11b6e42", "address": "fa:16:3e:e2:13:bd", "network": {"id": "0cebbe11-b08a-472b-b7d3-db59047dabfd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-202502212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "596d8ef54bf748bf8564c8be39d028ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1022b294-bd", "ovs_interfaceid": "1022b294-bd18-485e-a79a-25d9a11b6e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Converting VIF {"id": "1022b294-bd18-485e-a79a-25d9a11b6e42", "address": "fa:16:3e:e2:13:bd", "network": {"id": "0cebbe11-b08a-472b-b7d3-db59047dabfd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-202502212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "596d8ef54bf748bf8564c8be39d028ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1022b294-bd", "ovs_interfaceid": "1022b294-bd18-485e-a79a-25d9a11b6e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:13:bd,bridge_name='br-int',has_traffic_filtering=True,id=1022b294-bd18-485e-a79a-25d9a11b6e42,network=Network(0cebbe11-b08a-472b-b7d3-db59047dabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1022b294-bd') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lazy-loading 'pci_devices' on Instance uuid d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:01:09 user nova-compute[71312]:   <uuid>d5af1891-6ce7-408d-9f4d-9c5ecfe601b3</uuid>
Jul 25 10:01:09 user nova-compute[71312]:   <name>instance-0000000a</name>
Jul 25 10:01:09 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:01:09 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:01:09 user nova-compute[71312]:   <metadata>
Jul 25 10:01:09 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:01:09 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:01:09 user nova-compute[71312]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1357350949</nova:name>
Jul 25 10:01:09 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:01:09</nova:creationTime>
Jul 25 10:01:09 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:01:09 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:01:09 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:01:09 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:01:09 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:01:09 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:01:09 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:01:09 user nova-compute[71312]:       <nova:owner>
Jul 25 10:01:09 user nova-compute[71312]:         <nova:user uuid="e6d67152f5984cfb97ced29a539956e6">tempest-AttachSCSIVolumeTestJSON-1704055171-project-member</nova:user>
Jul 25 10:01:09 user nova-compute[71312]:         <nova:project uuid="596d8ef54bf748bf8564c8be39d028ff">tempest-AttachSCSIVolumeTestJSON-1704055171</nova:project>
Jul 25 10:01:09 user nova-compute[71312]:       </nova:owner>
Jul 25 10:01:09 user nova-compute[71312]:       <nova:root type="image" uuid="688e4d28-2f51-4eeb-a136-06b40da73ac0"/>
Jul 25 10:01:09 user nova-compute[71312]:       <nova:ports>
Jul 25 10:01:09 user nova-compute[71312]:         <nova:port uuid="1022b294-bd18-485e-a79a-25d9a11b6e42">
Jul 25 10:01:09 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 10:01:09 user nova-compute[71312]:         </nova:port>
Jul 25 10:01:09 user nova-compute[71312]:       </nova:ports>
Jul 25 10:01:09 user nova-compute[71312]:     </nova:instance>
Jul 25 10:01:09 user nova-compute[71312]:   </metadata>
Jul 25 10:01:09 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:01:09 user nova-compute[71312]:     <system>
Jul 25 10:01:09 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:01:09 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:01:09 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:01:09 user nova-compute[71312]:       <entry name="serial">d5af1891-6ce7-408d-9f4d-9c5ecfe601b3</entry>
Jul 25 10:01:09 user nova-compute[71312]:       <entry name="uuid">d5af1891-6ce7-408d-9f4d-9c5ecfe601b3</entry>
Jul 25 10:01:09 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:01:09 user nova-compute[71312]:     </system>
Jul 25 10:01:09 user nova-compute[71312]:   </sysinfo>
Jul 25 10:01:09 user nova-compute[71312]:   <os>
Jul 25 10:01:09 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:01:09 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:01:09 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:01:09 user nova-compute[71312]:   </os>
Jul 25 10:01:09 user nova-compute[71312]:   <features>
Jul 25 10:01:09 user nova-compute[71312]:     <acpi/>
Jul 25 10:01:09 user nova-compute[71312]:     <apic/>
Jul 25 10:01:09 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:01:09 user nova-compute[71312]:   </features>
Jul 25 10:01:09 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:01:09 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:01:09 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:01:09 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:01:09 user nova-compute[71312]:   </clock>
Jul 25 10:01:09 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:01:09 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:01:09 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:01:09 user nova-compute[71312]:   </cpu>
Jul 25 10:01:09 user nova-compute[71312]:   <devices>
Jul 25 10:01:09 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:01:09 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:01:09 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk"/>
Jul 25 10:01:09 user nova-compute[71312]:       <target dev="sda" bus="scsi"/>
Jul 25 10:01:09 user nova-compute[71312]:       <address type="drive" controller="0" unit="0"/>
Jul 25 10:01:09 user nova-compute[71312]:     </disk>
Jul 25 10:01:09 user nova-compute[71312]:     <disk type="file" device="cdrom">
Jul 25 10:01:09 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none"/>
Jul 25 10:01:09 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk.config"/>
Jul 25 10:01:09 user nova-compute[71312]:       <target dev="sdb" bus="scsi"/>
Jul 25 10:01:09 user nova-compute[71312]:       <address type="drive" controller="0" unit="1"/>
Jul 25 10:01:09 user nova-compute[71312]:     </disk>
Jul 25 10:01:09 user nova-compute[71312]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 25 10:01:09 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:01:09 user nova-compute[71312]:       <mac address="fa:16:3e:e2:13:bd"/>
Jul 25 10:01:09 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:01:09 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:01:09 user nova-compute[71312]:       <target dev="tap1022b294-bd"/>
Jul 25 10:01:09 user nova-compute[71312]:     </interface>
Jul 25 10:01:09 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:01:09 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/console.log" append="off"/>
Jul 25 10:01:09 user nova-compute[71312]:     </serial>
Jul 25 10:01:09 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:01:09 user nova-compute[71312]:     <video>
Jul 25 10:01:09 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:01:09 user nova-compute[71312]:     </video>
Jul 25 10:01:09 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:01:09 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:01:09 user nova-compute[71312]:     </rng>
Jul 25 10:01:09 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:01:09 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:01:09 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:01:09 user nova-compute[71312]:     </memballoon>
Jul 25 10:01:09 user nova-compute[71312]:   </devices>
Jul 25 10:01:09 user nova-compute[71312]: </domain>
Jul 25 10:01:09 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1357350949',display_name='tempest-AttachSCSIVolumeTestJSON-server-1357350949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1357350949',id=10,image_ref='688e4d28-2f51-4eeb-a136-06b40da73ac0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXEA+71avj89VbYClk00a8HT4J+zXMYN9DdWA6hh8jWaZSg9IkLIXSSWMqfWLeqbEP7IDChHSl3HAxapVcYmIWnM7WL4HgwsM62s/SPxNBVsff7wSlV3XoC0/rv0xlZIw==',key_name='tempest-keypair-838100764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='596d8ef54bf748bf8564c8be39d028ff',ramdisk_id='',reservation_id='r-8mm9djqj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='688e4d28-2f51-4eeb-a136-06b40da73ac0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1704055171',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1704055171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6d67152f5984cfb97ced29a539956e6',uuid=d5af1891-6ce7-408d-9f4d-9c5ecfe601b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1022b294-bd18-485e-a79a-25d9a11b6e42", "address": "fa:16:3e:e2:13:bd", "network": {"id": "0cebbe11-b08a-472b-b7d3-db59047dabfd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-202502212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "596d8ef54bf748bf8564c8be39d028ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1022b294-bd", "ovs_interfaceid": "1022b294-bd18-485e-a79a-25d9a11b6e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Converting VIF {"id": "1022b294-bd18-485e-a79a-25d9a11b6e42", "address": "fa:16:3e:e2:13:bd", "network": {"id": "0cebbe11-b08a-472b-b7d3-db59047dabfd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-202502212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "596d8ef54bf748bf8564c8be39d028ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1022b294-bd", "ovs_interfaceid": "1022b294-bd18-485e-a79a-25d9a11b6e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:13:bd,bridge_name='br-int',has_traffic_filtering=True,id=1022b294-bd18-485e-a79a-25d9a11b6e42,network=Network(0cebbe11-b08a-472b-b7d3-db59047dabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1022b294-bd') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG os_vif [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:13:bd,bridge_name='br-int',has_traffic_filtering=True,id=1022b294-bd18-485e-a79a-25d9a11b6e42,network=Network(0cebbe11-b08a-472b-b7d3-db59047dabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1022b294-bd') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1022b294-bd, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1022b294-bd, col_values=(('external_ids', {'iface-id': '1022b294-bd18-485e-a79a-25d9a11b6e42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:13:bd', 'vm-uuid': 'd5af1891-6ce7-408d-9f4d-9c5ecfe601b3'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:09 user nova-compute[71312]: INFO os_vif [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:13:bd,bridge_name='br-int',has_traffic_filtering=True,id=1022b294-bd18-485e-a79a-25d9a11b6e42,network=Network(0cebbe11-b08a-472b-b7d3-db59047dabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1022b294-bd')
Jul 25 10:01:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] No BDM found with device name sda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] No VIF found with MAC fa:16:3e:e2:13:bd, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:01:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Using config drive
Jul 25 10:01:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Creating config drive at /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk.config
Jul 25 10:01:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpap0ammmu {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpap0ammmu" returned: 0 in 0.067s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:01:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 10:01:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:01:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-d4fda1b6-d46e-4823-94bf-21a02f58dfd4 req-b19a9555-8336-44a9-904e-d0ff6e3493a1 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received event network-vif-plugged-682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d4fda1b6-d46e-4823-94bf-21a02f58dfd4 req-b19a9555-8336-44a9-904e-d0ff6e3493a1 service nova] Acquiring lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d4fda1b6-d46e-4823-94bf-21a02f58dfd4 req-b19a9555-8336-44a9-904e-d0ff6e3493a1 service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d4fda1b6-d46e-4823-94bf-21a02f58dfd4 req-b19a9555-8336-44a9-904e-d0ff6e3493a1 service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-d4fda1b6-d46e-4823-94bf-21a02f58dfd4 req-b19a9555-8336-44a9-904e-d0ff6e3493a1 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] No waiting events found dispatching network-vif-plugged-682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:01:10 user nova-compute[71312]: WARNING nova.compute.manager [req-d4fda1b6-d46e-4823-94bf-21a02f58dfd4 req-b19a9555-8336-44a9-904e-d0ff6e3493a1 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received unexpected event network-vif-plugged-682fce50-406a-4315-b5fc-b434a6c7c890 for instance with vm_state building and task_state spawning.
Jul 25 10:01:10 user nova-compute[71312]: DEBUG nova.network.neutron [req-0fd9c01f-1f7b-4d15-8fa7-04fe312b98c4 req-45f38a26-ba8c-4ae0-809b-3806db94de07 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Updated VIF entry in instance network info cache for port 1022b294-bd18-485e-a79a-25d9a11b6e42. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:01:10 user nova-compute[71312]: DEBUG nova.network.neutron [req-0fd9c01f-1f7b-4d15-8fa7-04fe312b98c4 req-45f38a26-ba8c-4ae0-809b-3806db94de07 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Updating instance_info_cache with network_info: [{"id": "1022b294-bd18-485e-a79a-25d9a11b6e42", "address": "fa:16:3e:e2:13:bd", "network": {"id": "0cebbe11-b08a-472b-b7d3-db59047dabfd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-202502212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "596d8ef54bf748bf8564c8be39d028ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1022b294-bd", "ovs_interfaceid": "1022b294-bd18-485e-a79a-25d9a11b6e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:01:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0fd9c01f-1f7b-4d15-8fa7-04fe312b98c4 req-45f38a26-ba8c-4ae0-809b-3806db94de07 service nova] Releasing lock "refresh_cache-d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:01:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:01:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:01:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-9266c4a5-3ad5-4747-be09-926f5043fefa req-f446b2b7-cbea-43ff-a8e8-2742e7bf159f service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received event network-vif-plugged-682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9266c4a5-3ad5-4747-be09-926f5043fefa req-f446b2b7-cbea-43ff-a8e8-2742e7bf159f service nova] Acquiring lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9266c4a5-3ad5-4747-be09-926f5043fefa req-f446b2b7-cbea-43ff-a8e8-2742e7bf159f service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9266c4a5-3ad5-4747-be09-926f5043fefa req-f446b2b7-cbea-43ff-a8e8-2742e7bf159f service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-9266c4a5-3ad5-4747-be09-926f5043fefa req-f446b2b7-cbea-43ff-a8e8-2742e7bf159f service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] No waiting events found dispatching network-vif-plugged-682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:01:12 user nova-compute[71312]: WARNING nova.compute.manager [req-9266c4a5-3ad5-4747-be09-926f5043fefa req-f446b2b7-cbea-43ff-a8e8-2742e7bf159f service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received unexpected event network-vif-plugged-682fce50-406a-4315-b5fc-b434a6c7c890 for instance with vm_state building and task_state spawning.
Jul 25 10:01:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-9266c4a5-3ad5-4747-be09-926f5043fefa req-f446b2b7-cbea-43ff-a8e8-2742e7bf159f service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Received event network-vif-plugged-1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9266c4a5-3ad5-4747-be09-926f5043fefa req-f446b2b7-cbea-43ff-a8e8-2742e7bf159f service nova] Acquiring lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9266c4a5-3ad5-4747-be09-926f5043fefa req-f446b2b7-cbea-43ff-a8e8-2742e7bf159f service nova] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9266c4a5-3ad5-4747-be09-926f5043fefa req-f446b2b7-cbea-43ff-a8e8-2742e7bf159f service nova] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-9266c4a5-3ad5-4747-be09-926f5043fefa req-f446b2b7-cbea-43ff-a8e8-2742e7bf159f service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] No waiting events found dispatching network-vif-plugged-1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:01:12 user nova-compute[71312]: WARNING nova.compute.manager [req-9266c4a5-3ad5-4747-be09-926f5043fefa req-f446b2b7-cbea-43ff-a8e8-2742e7bf159f service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Received unexpected event network-vif-plugged-1022b294-bd18-485e-a79a-25d9a11b6e42 for instance with vm_state building and task_state spawning.
Jul 25 10:01:12 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279273.2957673, c918b5d0-e8f8-40cc-9c25-71ea69d08756 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:01:13 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] VM Resumed (Lifecycle Event)
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:01:13 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Instance spawned successfully.
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:13 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279273.2992492, c918b5d0-e8f8-40cc-9c25-71ea69d08756 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:01:13 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] VM Started (Lifecycle Event)
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:01:13 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:01:13 user nova-compute[71312]: INFO nova.compute.manager [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Took 10.61 seconds to spawn the instance on the hypervisor.
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:01:13 user nova-compute[71312]: INFO nova.compute.manager [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Took 11.90 seconds to build instance.
Jul 25 10:01:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42db889f-5fbf-49b1-b841-2246f64fc1e5 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.138s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279273.9230292, d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:01:13 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] VM Resumed (Lifecycle Event)
Jul 25 10:01:13 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Instance spawned successfully.
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:01:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:13 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279273.9260085, d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:01:13 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] VM Started (Lifecycle Event)
Jul 25 10:01:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:01:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:01:14 user nova-compute[71312]: INFO nova.compute.manager [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Took 8.48 seconds to spawn the instance on the hypervisor.
Jul 25 10:01:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:01:14 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:01:14 user nova-compute[71312]: INFO nova.compute.manager [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Took 9.90 seconds to build instance.
Jul 25 10:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0aaec1bf-3a0e-43d6-8c32-df23925ac89c tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.076s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-3243d275-2a94-45c0-96fe-bcb6768ea3ac req-f9bccedc-19a1-4a97-9e52-972ae2e3f55e service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Received event network-vif-plugged-1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3243d275-2a94-45c0-96fe-bcb6768ea3ac req-f9bccedc-19a1-4a97-9e52-972ae2e3f55e service nova] Acquiring lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3243d275-2a94-45c0-96fe-bcb6768ea3ac req-f9bccedc-19a1-4a97-9e52-972ae2e3f55e service nova] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3243d275-2a94-45c0-96fe-bcb6768ea3ac req-f9bccedc-19a1-4a97-9e52-972ae2e3f55e service nova] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-3243d275-2a94-45c0-96fe-bcb6768ea3ac req-f9bccedc-19a1-4a97-9e52-972ae2e3f55e service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] No waiting events found dispatching network-vif-plugged-1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:01:14 user nova-compute[71312]: WARNING nova.compute.manager [req-3243d275-2a94-45c0-96fe-bcb6768ea3ac req-f9bccedc-19a1-4a97-9e52-972ae2e3f55e service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Received unexpected event network-vif-plugged-1022b294-bd18-485e-a79a-25d9a11b6e42 for instance with vm_state active and task_state None.
Jul 25 10:01:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:15 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:01:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:01:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 10:01:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:01:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:01:16 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:01:16 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lazy-loading 'info_cache' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:01:16 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Updating instance_info_cache with network_info: [{"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:01:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:01:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:01:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:01:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:01:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:21 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:01:21 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:01:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7132MB free_disk=25.692840576171875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 621e0aaf-d2c9-4269-9085-177fa5e1536b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9fb85501-6210-4bfd-b496-1891c79fd23c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 297fe407-3797-4681-ba83-e0f296780d57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 50f8683d-8b60-4095-9507-a969c37f85e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance c918b5d0-e8f8-40cc-9c25-71ea69d08756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:01:21 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing inventories for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 10:01:22 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Updating ProviderTree inventory for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 10:01:22 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Updating inventory in ProviderTree for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 10:01:22 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing aggregate associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 10:01:22 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing trait associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, traits: COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 10:01:22 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:01:22 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:01:22 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:01:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.933s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:01:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:01:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:01:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:01:46 user nova-compute[71312]: INFO nova.compute.claims [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Claim successful on node user
Jul 25 10:01:47 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:01:47 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:01:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:01:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:01:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:01:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:01:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:01:47 user nova-compute[71312]: INFO nova.virt.block_device [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Booting with volume 111f427e-b751-49ca-b2f5-56e733cfd496 at /dev/vda
Jul 25 10:01:47 user nova-compute[71312]: DEBUG nova.policy [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf17e9e8609440318fc8061235db7bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171fe858b48046a3817ece863e1ce913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:01:47 user nova-compute[71312]: DEBUG os_brick.utils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:01:47 user nova-compute[71312]: INFO oslo.privsep.daemon [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp1ds3458_/privsep.sock']
Jul 25 10:01:47 user sudo[82543]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp1ds3458_/privsep.sock
Jul 25 10:01:47 user sudo[82543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 25 10:01:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Successfully created port: 8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:01:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Successfully created port: ed410f46-787b-4200-8216-e8678856af7f {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Successfully created port: 81060ccd-4ba6-4d40-b340-320cfa254f38 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:49 user sudo[82543]: pam_unix(sudo:session): session closed for user root
Jul 25 10:01:49 user nova-compute[71312]: INFO oslo.privsep.daemon [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Spawned new privsep daemon via rootwrap
Jul 25 10:01:49 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 25 10:01:49 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 25 10:01:49 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 25 10:01:49 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82549
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[090e2286-50b0-4591-b8c2-fe05d9f08b5a]: (2,) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7dcdb2-00a6-4c98-82ac-3817cc6c4037]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:01:49 user nova-compute[71312]: WARNING os_brick.initiator.connectors.nvmeof [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.045s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6eef04-50d6-4a3e-9e81-3cab38b3d95a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f3583b-ea6a-4fa0-896f-6a1974a671fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Successfully created port: 468cbd00-2f81-4c6f-80c4-4561d2d57913 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7797e0b5-5861-4cf9-8861-0a7d542e4472]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:01:49 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:01:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9708970-486c-4043-b637-27efb20fae33]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG os_brick.utils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] <== get_connector_properties: return (2313ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:01:49 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating existing volume attachment record: f257d027-58f2-4a1c-9351-f868ba18d5a3 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:01:50 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Successfully created port: e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:01:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Successfully updated port: 8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:01:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-2e0e4758-d956-43f5-a2d5-807a7757b4e1 req-bb473253-c932-401f-8a1a-9b06489c6b07 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-changed-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-2e0e4758-d956-43f5-a2d5-807a7757b4e1 req-bb473253-c932-401f-8a1a-9b06489c6b07 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing instance network info cache due to event network-changed-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:01:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2e0e4758-d956-43f5-a2d5-807a7757b4e1 req-bb473253-c932-401f-8a1a-9b06489c6b07 service nova] Acquiring lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:01:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2e0e4758-d956-43f5-a2d5-807a7757b4e1 req-bb473253-c932-401f-8a1a-9b06489c6b07 service nova] Acquired lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:01:51 user nova-compute[71312]: DEBUG nova.network.neutron [req-2e0e4758-d956-43f5-a2d5-807a7757b4e1 req-bb473253-c932-401f-8a1a-9b06489c6b07 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing network info cache for port 8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:01:51 user nova-compute[71312]: DEBUG nova.network.neutron [req-2e0e4758-d956-43f5-a2d5-807a7757b4e1 req-bb473253-c932-401f-8a1a-9b06489c6b07 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:01:51 user nova-compute[71312]: DEBUG nova.network.neutron [req-2e0e4758-d956-43f5-a2d5-807a7757b4e1 req-bb473253-c932-401f-8a1a-9b06489c6b07 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:01:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2e0e4758-d956-43f5-a2d5-807a7757b4e1 req-bb473253-c932-401f-8a1a-9b06489c6b07 service nova] Releasing lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:01:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Successfully updated port: 3dabfadb-6d85-4051-8795-2b23c225c72e {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:01:52 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Successfully updated port: 10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-changed-3dabfadb-6d85-4051-8795-2b23c225c72e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing instance network info cache due to event network-changed-3dabfadb-6d85-4051-8795-2b23c225c72e. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] Acquiring lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] Acquired lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing network info cache for port 3dabfadb-6d85-4051-8795-2b23c225c72e {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Successfully updated port: ed410f46-787b-4200-8216-e8678856af7f {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] Releasing lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-changed-10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing instance network info cache due to event network-changed-10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] Acquiring lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] Acquired lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing network info cache for port 10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f561bcc4-f54f-462e-b486-f79cd343b86b req-ecaa8d56-6ddf-4a98-9559-1c7cbb209cf3 service nova] Releasing lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:01:54 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Successfully updated port: 81060ccd-4ba6-4d40-b340-320cfa254f38 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:01:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:01:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:01:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:01:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:01:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:01:54 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Successfully updated port: 468cbd00-2f81-4c6f-80c4-4561d2d57913 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-changed-ed410f46-787b-4200-8216-e8678856af7f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing instance network info cache due to event network-changed-ed410f46-787b-4200-8216-e8678856af7f. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] Acquiring lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] Acquired lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG nova.network.neutron [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing network info cache for port ed410f46-787b-4200-8216-e8678856af7f {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG nova.network.neutron [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG nova.network.neutron [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] Releasing lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-changed-81060ccd-4ba6-4d40-b340-320cfa254f38 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing instance network info cache due to event network-changed-81060ccd-4ba6-4d40-b340-320cfa254f38. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] Acquiring lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] Acquired lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG nova.network.neutron [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing network info cache for port 81060ccd-4ba6-4d40-b340-320cfa254f38 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG nova.network.neutron [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:01:55 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Successfully updated port: e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] Releasing lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-changed-468cbd00-2f81-4c6f-80c4-4561d2d57913 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing instance network info cache due to event network-changed-468cbd00-2f81-4c6f-80c4-4561d2d57913. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] Acquiring lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] Acquired lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing network info cache for port 468cbd00-2f81-4c6f-80c4-4561d2d57913 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf74ac8c-2f9a-45d2-a55c-149b8ada5a93 req-66b531f1-25da-4c73-a578-16aa582e059f service nova] Releasing lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquired lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:01:56 user nova-compute[71312]: INFO nova.virt.block_device [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Booting with volume de850d0b-017d-48b5-b6c5-fb47e57d47ec at /dev/vdb
Jul 25 10:01:56 user nova-compute[71312]: DEBUG os_brick.utils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd20e03-ed30-40b2-887c-487eb2024945]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[de431867-9656-41c5-bd7f-19bca0f8b869]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5aef24-e849-41bd-900b-88f0c2a05be1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[852d1b06-1e99-4b74-8e7d-9e367d18ae30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:01:56 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:01:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebdfea6-9748-4540-9419-57d112966419]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG os_brick.utils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:01:56 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating existing volume attachment record: 5ad448a7-b4f4-485b-980d-42fbe25e66ad {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:01:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-f7ff7b08-f3ae-423e-b4d9-d4e51c6651d3 req-5da3226f-4686-48a4-a29f-ba15b680ff3e service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-changed-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:01:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-f7ff7b08-f3ae-423e-b4d9-d4e51c6651d3 req-5da3226f-4686-48a4-a29f-ba15b680ff3e service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing instance network info cache due to event network-changed-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:01:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f7ff7b08-f3ae-423e-b4d9-d4e51c6651d3 req-5da3226f-4686-48a4-a29f-ba15b680ff3e service nova] Acquiring lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:01:58 user nova-compute[71312]: DEBUG nova.network.neutron [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating instance_info_cache with network_info: [{"id": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "address": "fa:16:3e:4b:a2:8f", "network": {"id": "8c9da59c-8815-4721-baf9-4931ceb98e10", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1623323297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6bdd57-e2", "ovs_interfaceid": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81060ccd-4ba6-4d40-b340-320cfa254f38", "address": "fa:16:3e:1b:2f:74", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81060ccd-4b", "ovs_interfaceid": "81060ccd-4ba6-4d40-b340-320cfa254f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "address": "fa:16:3e:27:68:29", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468cbd00-2f", "ovs_interfaceid": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "address": "fa:16:3e:20:5d:92", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90ea84d-dc", "ovs_interfaceid": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:01:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Releasing lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:01:58 user nova-compute[71312]: DEBUG nova.compute.manager [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Instance network_info: |[{"id": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "address": "fa:16:3e:4b:a2:8f", "network": {"id": "8c9da59c-8815-4721-baf9-4931ceb98e10", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1623323297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6bdd57-e2", "ovs_interfaceid": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81060ccd-4ba6-4d40-b340-320cfa254f38", "address": "fa:16:3e:1b:2f:74", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81060ccd-4b", "ovs_interfaceid": "81060ccd-4ba6-4d40-b340-320cfa254f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "address": "fa:16:3e:27:68:29", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468cbd00-2f", "ovs_interfaceid": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "address": "fa:16:3e:20:5d:92", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90ea84d-dc", "ovs_interfaceid": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:01:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f7ff7b08-f3ae-423e-b4d9-d4e51c6651d3 req-5da3226f-4686-48a4-a29f-ba15b680ff3e service nova] Acquired lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:01:58 user nova-compute[71312]: DEBUG nova.network.neutron [req-f7ff7b08-f3ae-423e-b4d9-d4e51c6651d3 req-5da3226f-4686-48a4-a29f-ba15b680ff3e service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing network info cache for port e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:01:59 user nova-compute[71312]: DEBUG nova.network.neutron [req-f7ff7b08-f3ae-423e-b4d9-d4e51c6651d3 req-5da3226f-4686-48a4-a29f-ba15b680ff3e service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updated VIF entry in instance network info cache for port e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:01:59 user nova-compute[71312]: DEBUG nova.network.neutron [req-f7ff7b08-f3ae-423e-b4d9-d4e51c6651d3 req-5da3226f-4686-48a4-a29f-ba15b680ff3e service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating instance_info_cache with network_info: [{"id": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "address": "fa:16:3e:4b:a2:8f", "network": {"id": "8c9da59c-8815-4721-baf9-4931ceb98e10", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1623323297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6bdd57-e2", "ovs_interfaceid": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81060ccd-4ba6-4d40-b340-320cfa254f38", "address": "fa:16:3e:1b:2f:74", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81060ccd-4b", "ovs_interfaceid": "81060ccd-4ba6-4d40-b340-320cfa254f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "address": "fa:16:3e:27:68:29", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468cbd00-2f", "ovs_interfaceid": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "address": "fa:16:3e:20:5d:92", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90ea84d-dc", "ovs_interfaceid": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f7ff7b08-f3ae-423e-b4d9-d4e51c6651d3 req-5da3226f-4686-48a4-a29f-ba15b680ff3e service nova] Releasing lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:01:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:01:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:01:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:01:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:01:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:01:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:03 user nova-compute[71312]: INFO nova.virt.block_device [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Booting with volume 45999e73-d8f4-4c0d-9ea5-9d77e0e61343 at /dev/vdc
Jul 25 10:02:03 user nova-compute[71312]: DEBUG os_brick.utils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7108f80-c51a-4e2a-8720-b490ae0329b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7840e011-f921-4749-8b65-d9b6624ac2df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8adf806-7359-4bd0-bc37-e0aea6cfe5ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e28625-c307-496d-a851-0d44aee9b6dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:02:03 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:02:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[34999882-9466-4c99-8ebf-6664fa596446]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG os_brick.utils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:03 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating existing volume attachment record: 88b7bcea-c656-4b1a-b5f7-df9607a28224 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:02:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:02:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Creating image(s)
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Ensure instance console log exists: /opt/stack/data/nova/instances/7e67c6e4-1c08-4d49-8537-5d0c9899c9bd/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Start _get_guest_xml network_info=[{"id": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "address": "fa:16:3e:4b:a2:8f", "network": {"id": "8c9da59c-8815-4721-baf9-4931ceb98e10", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1623323297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6bdd57-e2", "ovs_interfaceid": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81060ccd-4ba6-4d40-b340-320cfa254f38", "address": "fa:16:3e:1b:2f:74", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81060ccd-4b", "ovs_interfaceid": "81060ccd-4ba6-4d40-b340-320cfa254f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "address": "fa:16:3e:27:68:29", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468cbd00-2f", "ovs_interfaceid": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "address": "fa:16:3e:20:5d:92", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90ea84d-dc", "ovs_interfaceid": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'f257d027-58f2-4a1c-9351-f868ba18d5a3', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSbaYUsD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e67c6e4-1c08-4d49-8537-5d0c9899c9bd', 'attached_at': '', 'detached_at': '', 'volume_id': '111f427e-b751-49ca-b2f5-56e733cfd496', 'serial': '111f427e-b751-49ca-b2f5-56e733cfd496'}, 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 1, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '5ad448a7-b4f4-485b-980d-42fbe25e66ad', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WIUOFDpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e67c6e4-1c08-4d49-8537-5d0c9899c9bd', 'attached_at': '', 'detached_at': '', 'volume_id': 'de850d0b-017d-48b5-b6c5-fb47e57d47ec', 'serial': 'de850d0b-017d-48b5-b6c5-fb47e57d47ec'}, 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 2, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '88b7bcea-c656-4b1a-b5f7-df9607a28224', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyoYkncQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e67c6e4-1c08-4d49-8537-5d0c9899c9bd', 'attached_at': '', 'detached_at': '', 'volume_id': '45999e73-d8f4-4c0d-9ea5-9d77e0e61343', 'serial': '45999e73-d8f4-4c0d-9ea5-9d77e0e61343'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:02:09 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:02:09 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG os_brick.initiator.connector [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Factory for ISCSI on None {{(pid=71312) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSbaYUsD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:09 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:09 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:09 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c48b024-6981-4eab-98f0-aae9e86687cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:02:09 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcd1a24-e094-4cd4-bc62-8bbcfe42281f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496] added
Jul 25 10:02:09 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b93ee7-3b67-40ab-92aa-ace32bd4adfa]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[45466c31-0da1-4292-b64b-87a3924b0219]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSbaYUsD {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSbaYUsD" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ad418a-2abd-41c9-9f6a-6d994b4a1aa3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PSbaYUsD'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad2e9ff-352c-45af-a7b8-9e8a4ac374f8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a480c2be-6f40-48ca-9e8d-a5a77a755d68]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 10:02:10 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 10:02:10 user nova-compute[71312]:  {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:10 user nova-compute[71312]: WARNING os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 10:02:10 user nova-compute[71312]: 
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13c3a6b-becb-4da6-b406-e2cca877a6da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496, portal: 172.16.0.220,3260]
Jul 25 10:02:10 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496, portal: 172.16.0.220,3260] successful.
Jul 25 10:02:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd362781-5eef-4e3b-a86d-13986393838d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c494700-0c7d-4329-8c30-6aaf73b1618b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9892bc8a-d03e-4433-b343-681a41ca4c55]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:02:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSbaYUsD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23337336365393431', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337336365393431', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WIUOFDpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:11 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:11 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:11 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c996c6-8505-4850-8347-5c992ab9c663]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:02:11 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2b8459-7ef1-47ea-a116-283e23af8707]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec] added
Jul 25 10:02:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b257dad-7b38-40c5-a0bf-446692bdc8f6]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a72bcbe-1a79-42ba-84b6-cc90536c196c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WIUOFDpr {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WIUOFDpr" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d6b33c-dda0-4438-9015-82c9a15598a6]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WIUOFDpr'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecfae4c-6287-42c2-877d-f13aefa135cc]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe4ef2e-229b-47e2-9865-ee85e90fb6bf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c24a2b-8d94-4964-b8ca-ac6e9ba61fe6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec, portal: 172.16.0.220,3260]
Jul 25 10:02:11 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec, portal: 172.16.0.220,3260] successful.
Jul 25 10:02:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb8f245-feef-4871-ad08-94d5bc07f982]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[06045dab-238c-47a3-b6ba-19c2768e12c0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:11 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:11 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42ab58e-8d2f-428f-aa7c-0cbc923b70c8]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:02:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WIUOFDpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '26635636233313363', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635636233313363', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyoYkncQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:12 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:12 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:12 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c71f74-f4e6-4e48-ad95-bc25a9a5d801]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:02:12 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[112e6b9d-b94e-4914-b7b3-02abf26dfcb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343] added
Jul 25 10:02:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdb17da-7a79-40b0-b072-5502c91ee0d2]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d6bc8e-b5f1-4024-a273-e0d994de21dc]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WyoYkncQ {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WyoYkncQ" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[69135c50-87f8-4b20-9d1d-b6fb49249e89]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WyoYkncQ'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[318b0bc8-b32d-477a-9471-384740ff2c3f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e681ee8-a8ed-49ce-9c0d-edb30ade270b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:12 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:12 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1da8ed-3e14-4c64-99c2-72de37859834]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343, portal: 172.16.0.220,3260]
Jul 25 10:02:12 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343, portal: 172.16.0.220,3260] successful.
Jul 25 10:02:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d9c7df-f495-4c43-a589-cbd15ee1bdef]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3a2319-b4a2-455c-9af7-d7a971864093]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:12 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:12 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:12 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:12 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f3a246-4acb-4bfd-8a8e-dcc57da3dd25]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyoYkncQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23835346433333765', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835346433333765', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "address": "fa:16:3e:4b:a2:8f", "network": {"id": "8c9da59c-8815-4721-baf9-4931ceb98e10", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1623323297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6bdd57-e2", "ovs_interfaceid": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "address": "fa:16:3e:4b:a2:8f", "network": {"id": "8c9da59c-8815-4721-baf9-4931ceb98e10", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1623323297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6bdd57-e2", "ovs_interfaceid": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:a2:8f,bridge_name='br-int',has_traffic_filtering=True,id=8e6bdd57-e2ac-4de4-bfb6-a2e511203f21,network=Network(8c9da59c-8815-4721-baf9-4931ceb98e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e6bdd57-e2') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:33:82,bridge_name='br-int',has_traffic_filtering=True,id=3dabfadb-6d85-4051-8795-2b23c225c72e,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3dabfadb-6d') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:52:60,bridge_name='br-int',has_traffic_filtering=True,id=10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap10cf2e6e-6c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d2:04,bridge_name='br-int',has_traffic_filtering=True,id=ed410f46-787b-4200-8216-e8678856af7f,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped410f46-78') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81060ccd-4ba6-4d40-b340-320cfa254f38", "address": "fa:16:3e:1b:2f:74", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81060ccd-4b", "ovs_interfaceid": "81060ccd-4ba6-4d40-b340-320cfa254f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "81060ccd-4ba6-4d40-b340-320cfa254f38", "address": "fa:16:3e:1b:2f:74", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81060ccd-4b", "ovs_interfaceid": "81060ccd-4ba6-4d40-b340-320cfa254f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2f:74,bridge_name='br-int',has_traffic_filtering=True,id=81060ccd-4ba6-4d40-b340-320cfa254f38,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81060ccd-4b') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "address": "fa:16:3e:27:68:29", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468cbd00-2f", "ovs_interfaceid": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "address": "fa:16:3e:27:68:29", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468cbd00-2f", "ovs_interfaceid": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:68:29,bridge_name='br-int',has_traffic_filtering=True,id=468cbd00-2f81-4c6f-80c4-4561d2d57913,network=Network(8aaee903-2925-4f3e-966e-ae4afb3db554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468cbd00-2f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "address": "fa:16:3e:20:5d:92", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90ea84d-dc", "ovs_interfaceid": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "address": "fa:16:3e:20:5d:92", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90ea84d-dc", "ovs_interfaceid": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:5d:92,bridge_name='br-int',has_traffic_filtering=True,id=e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc,network=Network(8aaee903-2925-4f3e-966e-ae4afb3db554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90ea84d-dc') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.objects.instance [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:02:13 user nova-compute[71312]:   <uuid>7e67c6e4-1c08-4d49-8537-5d0c9899c9bd</uuid>
Jul 25 10:02:13 user nova-compute[71312]:   <name>instance-0000000b</name>
Jul 25 10:02:13 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:02:13 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:02:13 user nova-compute[71312]:   <metadata>
Jul 25 10:02:13 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:02:13 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:02:13 user nova-compute[71312]:       <nova:name>tempest-device-tagging-server-265559078</nova:name>
Jul 25 10:02:13 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:02:09</nova:creationTime>
Jul 25 10:02:13 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:02:13 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:02:13 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:02:13 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:02:13 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:02:13 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:02:13 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:02:13 user nova-compute[71312]:       <nova:owner>
Jul 25 10:02:13 user nova-compute[71312]:         <nova:user uuid="bf17e9e8609440318fc8061235db7bae">tempest-TaggedBootDevicesTest-886816588-project-member</nova:user>
Jul 25 10:02:13 user nova-compute[71312]:         <nova:project uuid="171fe858b48046a3817ece863e1ce913">tempest-TaggedBootDevicesTest-886816588</nova:project>
Jul 25 10:02:13 user nova-compute[71312]:       </nova:owner>
Jul 25 10:02:13 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:02:13 user nova-compute[71312]:       <nova:ports>
Jul 25 10:02:13 user nova-compute[71312]:         <nova:port uuid="8e6bdd57-e2ac-4de4-bfb6-a2e511203f21">
Jul 25 10:02:13 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 10:02:13 user nova-compute[71312]:         </nova:port>
Jul 25 10:02:13 user nova-compute[71312]:         <nova:port uuid="3dabfadb-6d85-4051-8795-2b23c225c72e">
Jul 25 10:02:13 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.40" ipVersion="4"/>
Jul 25 10:02:13 user nova-compute[71312]:         </nova:port>
Jul 25 10:02:13 user nova-compute[71312]:         <nova:port uuid="10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d">
Jul 25 10:02:13 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.188" ipVersion="4"/>
Jul 25 10:02:13 user nova-compute[71312]:         </nova:port>
Jul 25 10:02:13 user nova-compute[71312]:         <nova:port uuid="ed410f46-787b-4200-8216-e8678856af7f">
Jul 25 10:02:13 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.55" ipVersion="4"/>
Jul 25 10:02:13 user nova-compute[71312]:         </nova:port>
Jul 25 10:02:13 user nova-compute[71312]:         <nova:port uuid="81060ccd-4ba6-4d40-b340-320cfa254f38">
Jul 25 10:02:13 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.214" ipVersion="4"/>
Jul 25 10:02:13 user nova-compute[71312]:         </nova:port>
Jul 25 10:02:13 user nova-compute[71312]:         <nova:port uuid="468cbd00-2f81-4c6f-80c4-4561d2d57913">
Jul 25 10:02:13 user nova-compute[71312]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 25 10:02:13 user nova-compute[71312]:         </nova:port>
Jul 25 10:02:13 user nova-compute[71312]:         <nova:port uuid="e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc">
Jul 25 10:02:13 user nova-compute[71312]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 25 10:02:13 user nova-compute[71312]:         </nova:port>
Jul 25 10:02:13 user nova-compute[71312]:       </nova:ports>
Jul 25 10:02:13 user nova-compute[71312]:     </nova:instance>
Jul 25 10:02:13 user nova-compute[71312]:   </metadata>
Jul 25 10:02:13 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:02:13 user nova-compute[71312]:     <system>
Jul 25 10:02:13 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:02:13 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:02:13 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:02:13 user nova-compute[71312]:       <entry name="serial">7e67c6e4-1c08-4d49-8537-5d0c9899c9bd</entry>
Jul 25 10:02:13 user nova-compute[71312]:       <entry name="uuid">7e67c6e4-1c08-4d49-8537-5d0c9899c9bd</entry>
Jul 25 10:02:13 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:02:13 user nova-compute[71312]:     </system>
Jul 25 10:02:13 user nova-compute[71312]:   </sysinfo>
Jul 25 10:02:13 user nova-compute[71312]:   <os>
Jul 25 10:02:13 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:02:13 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:02:13 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:02:13 user nova-compute[71312]:   </os>
Jul 25 10:02:13 user nova-compute[71312]:   <features>
Jul 25 10:02:13 user nova-compute[71312]:     <acpi/>
Jul 25 10:02:13 user nova-compute[71312]:     <apic/>
Jul 25 10:02:13 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:02:13 user nova-compute[71312]:   </features>
Jul 25 10:02:13 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:02:13 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:02:13 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:02:13 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:02:13 user nova-compute[71312]:   </clock>
Jul 25 10:02:13 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:02:13 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:02:13 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:02:13 user nova-compute[71312]:   </cpu>
Jul 25 10:02:13 user nova-compute[71312]:   <devices>
Jul 25 10:02:13 user nova-compute[71312]:     <disk type="file" device="cdrom">
Jul 25 10:02:13 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none"/>
Jul 25 10:02:13 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/7e67c6e4-1c08-4d49-8537-5d0c9899c9bd/disk.config"/>
Jul 25 10:02:13 user nova-compute[71312]:       <target dev="hda" bus="ide"/>
Jul 25 10:02:13 user nova-compute[71312]:     </disk>
Jul 25 10:02:13 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:02:13 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:02:13 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Jul 25 10:02:13 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:02:13 user nova-compute[71312]:       <serial>111f427e-b751-49ca-b2f5-56e733cfd496</serial>
Jul 25 10:02:13 user nova-compute[71312]:     </disk>
Jul 25 10:02:13 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:02:13 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:02:13 user nova-compute[71312]:       <source dev="/dev/sdc"/>
Jul 25 10:02:13 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Jul 25 10:02:13 user nova-compute[71312]:       <serial>de850d0b-017d-48b5-b6c5-fb47e57d47ec</serial>
Jul 25 10:02:13 user nova-compute[71312]:     </disk>
Jul 25 10:02:13 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:02:13 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:02:13 user nova-compute[71312]:       <source dev="/dev/sdd"/>
Jul 25 10:02:13 user nova-compute[71312]:       <target dev="vdc" bus="virtio"/>
Jul 25 10:02:13 user nova-compute[71312]:       <serial>45999e73-d8f4-4c0d-9ea5-9d77e0e61343</serial>
Jul 25 10:02:13 user nova-compute[71312]:     </disk>
Jul 25 10:02:13 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:02:13 user nova-compute[71312]:       <mac address="fa:16:3e:4b:a2:8f"/>
Jul 25 10:02:13 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:02:13 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:02:13 user nova-compute[71312]:       <target dev="tap8e6bdd57-e2"/>
Jul 25 10:02:13 user nova-compute[71312]:     </interface>
Jul 25 10:02:13 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:02:13 user nova-compute[71312]:       <mac address="fa:16:3e:6d:33:82"/>
Jul 25 10:02:13 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:02:13 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:02:13 user nova-compute[71312]:       <target dev="tap3dabfadb-6d"/>
Jul 25 10:02:13 user nova-compute[71312]:     </interface>
Jul 25 10:02:13 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:02:13 user nova-compute[71312]:       <mac address="fa:16:3e:c1:52:60"/>
Jul 25 10:02:13 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:02:13 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:02:13 user nova-compute[71312]:       <target dev="tap10cf2e6e-6c"/>
Jul 25 10:02:13 user nova-compute[71312]:     </interface>
Jul 25 10:02:13 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:02:13 user nova-compute[71312]:       <mac address="fa:16:3e:8c:d2:04"/>
Jul 25 10:02:13 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:02:13 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:02:13 user nova-compute[71312]:       <target dev="taped410f46-78"/>
Jul 25 10:02:13 user nova-compute[71312]:     </interface>
Jul 25 10:02:13 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:02:13 user nova-compute[71312]:       <mac address="fa:16:3e:1b:2f:74"/>
Jul 25 10:02:13 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:02:13 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:02:13 user nova-compute[71312]:       <target dev="tap81060ccd-4b"/>
Jul 25 10:02:13 user nova-compute[71312]:     </interface>
Jul 25 10:02:13 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:02:13 user nova-compute[71312]:       <mac address="fa:16:3e:27:68:29"/>
Jul 25 10:02:13 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:02:13 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:02:13 user nova-compute[71312]:       <target dev="tap468cbd00-2f"/>
Jul 25 10:02:13 user nova-compute[71312]:     </interface>
Jul 25 10:02:13 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:02:13 user nova-compute[71312]:       <mac address="fa:16:3e:20:5d:92"/>
Jul 25 10:02:13 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:02:13 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:02:13 user nova-compute[71312]:       <target dev="tape90ea84d-dc"/>
Jul 25 10:02:13 user nova-compute[71312]:     </interface>
Jul 25 10:02:13 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:02:13 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/7e67c6e4-1c08-4d49-8537-5d0c9899c9bd/console.log" append="off"/>
Jul 25 10:02:13 user nova-compute[71312]:     </serial>
Jul 25 10:02:13 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:02:13 user nova-compute[71312]:     <video>
Jul 25 10:02:13 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:02:13 user nova-compute[71312]:     </video>
Jul 25 10:02:13 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:02:13 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:02:13 user nova-compute[71312]:     </rng>
Jul 25 10:02:13 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:02:13 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:02:13 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:02:13 user nova-compute[71312]:     </memballoon>
Jul 25 10:02:13 user nova-compute[71312]:   </devices>
Jul 25 10:02:13 user nova-compute[71312]: </domain>
Jul 25 10:02:13 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "address": "fa:16:3e:4b:a2:8f", "network": {"id": "8c9da59c-8815-4721-baf9-4931ceb98e10", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1623323297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6bdd57-e2", "ovs_interfaceid": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "address": "fa:16:3e:4b:a2:8f", "network": {"id": "8c9da59c-8815-4721-baf9-4931ceb98e10", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1623323297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6bdd57-e2", "ovs_interfaceid": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:a2:8f,bridge_name='br-int',has_traffic_filtering=True,id=8e6bdd57-e2ac-4de4-bfb6-a2e511203f21,network=Network(8c9da59c-8815-4721-baf9-4931ceb98e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e6bdd57-e2') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG os_vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:a2:8f,bridge_name='br-int',has_traffic_filtering=True,id=8e6bdd57-e2ac-4de4-bfb6-a2e511203f21,network=Network(8c9da59c-8815-4721-baf9-4931ceb98e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e6bdd57-e2') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e6bdd57-e2, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e6bdd57-e2, col_values=(('external_ids', {'iface-id': '8e6bdd57-e2ac-4de4-bfb6-a2e511203f21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:a2:8f', 'vm-uuid': '7e67c6e4-1c08-4d49-8537-5d0c9899c9bd'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:13 user nova-compute[71312]: INFO os_vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:a2:8f,bridge_name='br-int',has_traffic_filtering=True,id=8e6bdd57-e2ac-4de4-bfb6-a2e511203f21,network=Network(8c9da59c-8815-4721-baf9-4931ceb98e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e6bdd57-e2')
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:33:82,bridge_name='br-int',has_traffic_filtering=True,id=3dabfadb-6d85-4051-8795-2b23c225c72e,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3dabfadb-6d') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG os_vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:33:82,bridge_name='br-int',has_traffic_filtering=True,id=3dabfadb-6d85-4051-8795-2b23c225c72e,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3dabfadb-6d') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dabfadb-6d, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3dabfadb-6d, col_values=(('external_ids', {'iface-id': '3dabfadb-6d85-4051-8795-2b23c225c72e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:33:82', 'vm-uuid': '7e67c6e4-1c08-4d49-8537-5d0c9899c9bd'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:13 user nova-compute[71312]: INFO os_vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:33:82,bridge_name='br-int',has_traffic_filtering=True,id=3dabfadb-6d85-4051-8795-2b23c225c72e,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3dabfadb-6d')
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:52:60,bridge_name='br-int',has_traffic_filtering=True,id=10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap10cf2e6e-6c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG os_vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:52:60,bridge_name='br-int',has_traffic_filtering=True,id=10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap10cf2e6e-6c') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10cf2e6e-6c, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10cf2e6e-6c, col_values=(('external_ids', {'iface-id': '10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:52:60', 'vm-uuid': '7e67c6e4-1c08-4d49-8537-5d0c9899c9bd'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:13 user nova-compute[71312]: INFO os_vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:52:60,bridge_name='br-int',has_traffic_filtering=True,id=10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap10cf2e6e-6c')
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d2:04,bridge_name='br-int',has_traffic_filtering=True,id=ed410f46-787b-4200-8216-e8678856af7f,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped410f46-78') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG os_vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d2:04,bridge_name='br-int',has_traffic_filtering=True,id=ed410f46-787b-4200-8216-e8678856af7f,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped410f46-78') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped410f46-78, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped410f46-78, col_values=(('external_ids', {'iface-id': 'ed410f46-787b-4200-8216-e8678856af7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:d2:04', 'vm-uuid': '7e67c6e4-1c08-4d49-8537-5d0c9899c9bd'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: INFO os_vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d2:04,bridge_name='br-int',has_traffic_filtering=True,id=ed410f46-787b-4200-8216-e8678856af7f,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped410f46-78')
Jul 25 10:02:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81060ccd-4ba6-4d40-b340-320cfa254f38", "address": "fa:16:3e:1b:2f:74", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81060ccd-4b", "ovs_interfaceid": "81060ccd-4ba6-4d40-b340-320cfa254f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "81060ccd-4ba6-4d40-b340-320cfa254f38", "address": "fa:16:3e:1b:2f:74", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81060ccd-4b", "ovs_interfaceid": "81060ccd-4ba6-4d40-b340-320cfa254f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2f:74,bridge_name='br-int',has_traffic_filtering=True,id=81060ccd-4ba6-4d40-b340-320cfa254f38,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81060ccd-4b') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG os_vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2f:74,bridge_name='br-int',has_traffic_filtering=True,id=81060ccd-4ba6-4d40-b340-320cfa254f38,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81060ccd-4b') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81060ccd-4b, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81060ccd-4b, col_values=(('external_ids', {'iface-id': '81060ccd-4ba6-4d40-b340-320cfa254f38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:2f:74', 'vm-uuid': '7e67c6e4-1c08-4d49-8537-5d0c9899c9bd'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: INFO os_vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2f:74,bridge_name='br-int',has_traffic_filtering=True,id=81060ccd-4ba6-4d40-b340-320cfa254f38,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81060ccd-4b')
Jul 25 10:02:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "address": "fa:16:3e:27:68:29", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468cbd00-2f", "ovs_interfaceid": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "address": "fa:16:3e:27:68:29", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468cbd00-2f", "ovs_interfaceid": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:68:29,bridge_name='br-int',has_traffic_filtering=True,id=468cbd00-2f81-4c6f-80c4-4561d2d57913,network=Network(8aaee903-2925-4f3e-966e-ae4afb3db554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468cbd00-2f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG os_vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:68:29,bridge_name='br-int',has_traffic_filtering=True,id=468cbd00-2f81-4c6f-80c4-4561d2d57913,network=Network(8aaee903-2925-4f3e-966e-ae4afb3db554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468cbd00-2f') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap468cbd00-2f, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap468cbd00-2f, col_values=(('external_ids', {'iface-id': '468cbd00-2f81-4c6f-80c4-4561d2d57913', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:68:29', 'vm-uuid': '7e67c6e4-1c08-4d49-8537-5d0c9899c9bd'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: INFO os_vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:68:29,bridge_name='br-int',has_traffic_filtering=True,id=468cbd00-2f81-4c6f-80c4-4561d2d57913,network=Network(8aaee903-2925-4f3e-966e-ae4afb3db554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468cbd00-2f')
Jul 25 10:02:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "address": "fa:16:3e:20:5d:92", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90ea84d-dc", "ovs_interfaceid": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "address": "fa:16:3e:20:5d:92", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90ea84d-dc", "ovs_interfaceid": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:5d:92,bridge_name='br-int',has_traffic_filtering=True,id=e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc,network=Network(8aaee903-2925-4f3e-966e-ae4afb3db554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90ea84d-dc') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG os_vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:5d:92,bridge_name='br-int',has_traffic_filtering=True,id=e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc,network=Network(8aaee903-2925-4f3e-966e-ae4afb3db554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90ea84d-dc') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape90ea84d-dc, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape90ea84d-dc, col_values=(('external_ids', {'iface-id': 'e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:5d:92', 'vm-uuid': '7e67c6e4-1c08-4d49-8537-5d0c9899c9bd'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:14 user nova-compute[71312]: INFO os_vif [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:5d:92,bridge_name='br-int',has_traffic_filtering=True,id=e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc,network=Network(8aaee903-2925-4f3e-966e-ae4afb3db554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90ea84d-dc')
Jul 25 10:02:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] No BDM found with device name hda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] No VIF found with MAC fa:16:3e:4b:a2:8f, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] No VIF found with MAC fa:16:3e:1b:2f:74, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:02:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Using config drive
Jul 25 10:02:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Creating config drive at /opt/stack/data/nova/instances/7e67c6e4-1c08-4d49-8537-5d0c9899c9bd/disk.config
Jul 25 10:02:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7e67c6e4-1c08-4d49-8537-5d0c9899c9bd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9dsqmp7j {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7e67c6e4-1c08-4d49-8537-5d0c9899c9bd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9dsqmp7j" returned: 0 in 0.057s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-83c914f9-1f99-4683-8cbc-88de7bff5cde req-b299db75-48e8-4ac7-9122-d95592f69205 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-83c914f9-1f99-4683-8cbc-88de7bff5cde req-b299db75-48e8-4ac7-9122-d95592f69205 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-83c914f9-1f99-4683-8cbc-88de7bff5cde req-b299db75-48e8-4ac7-9122-d95592f69205 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-83c914f9-1f99-4683-8cbc-88de7bff5cde req-b299db75-48e8-4ac7-9122-d95592f69205 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-83c914f9-1f99-4683-8cbc-88de7bff5cde req-b299db75-48e8-4ac7-9122-d95592f69205 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:16 user nova-compute[71312]: WARNING nova.compute.manager [req-83c914f9-1f99-4683-8cbc-88de7bff5cde req-b299db75-48e8-4ac7-9122-d95592f69205 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 for instance with vm_state building and task_state spawning.
Jul 25 10:02:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-b4d8f978-8bed-4840-86c9-711bc8b2d214 req-de6db352-cd8e-4cde-b5b7-4c41635393da service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-3dabfadb-6d85-4051-8795-2b23c225c72e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b4d8f978-8bed-4840-86c9-711bc8b2d214 req-de6db352-cd8e-4cde-b5b7-4c41635393da service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b4d8f978-8bed-4840-86c9-711bc8b2d214 req-de6db352-cd8e-4cde-b5b7-4c41635393da service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b4d8f978-8bed-4840-86c9-711bc8b2d214 req-de6db352-cd8e-4cde-b5b7-4c41635393da service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-b4d8f978-8bed-4840-86c9-711bc8b2d214 req-de6db352-cd8e-4cde-b5b7-4c41635393da service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-3dabfadb-6d85-4051-8795-2b23c225c72e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:16 user nova-compute[71312]: WARNING nova.compute.manager [req-b4d8f978-8bed-4840-86c9-711bc8b2d214 req-de6db352-cd8e-4cde-b5b7-4c41635393da service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-3dabfadb-6d85-4051-8795-2b23c225c72e for instance with vm_state building and task_state spawning.
Jul 25 10:02:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-56be1a3d-fc3d-42dd-a37e-78cca5485dd0 req-9f7254d1-2b59-4e3f-b9fe-4731a76551ae service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-468cbd00-2f81-4c6f-80c4-4561d2d57913 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-56be1a3d-fc3d-42dd-a37e-78cca5485dd0 req-9f7254d1-2b59-4e3f-b9fe-4731a76551ae service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-56be1a3d-fc3d-42dd-a37e-78cca5485dd0 req-9f7254d1-2b59-4e3f-b9fe-4731a76551ae service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-56be1a3d-fc3d-42dd-a37e-78cca5485dd0 req-9f7254d1-2b59-4e3f-b9fe-4731a76551ae service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-56be1a3d-fc3d-42dd-a37e-78cca5485dd0 req-9f7254d1-2b59-4e3f-b9fe-4731a76551ae service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-468cbd00-2f81-4c6f-80c4-4561d2d57913 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:18 user nova-compute[71312]: WARNING nova.compute.manager [req-56be1a3d-fc3d-42dd-a37e-78cca5485dd0 req-9f7254d1-2b59-4e3f-b9fe-4731a76551ae service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-468cbd00-2f81-4c6f-80c4-4561d2d57913 for instance with vm_state building and task_state spawning.
Jul 25 10:02:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:18 user nova-compute[71312]: WARNING nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 for instance with vm_state building and task_state spawning.
Jul 25 10:02:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:18 user nova-compute[71312]: WARNING nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d for instance with vm_state building and task_state spawning.
Jul 25 10:02:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:18 user nova-compute[71312]: WARNING nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d for instance with vm_state building and task_state spawning.
Jul 25 10:02:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-ed410f46-787b-4200-8216-e8678856af7f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-ed410f46-787b-4200-8216-e8678856af7f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:18 user nova-compute[71312]: WARNING nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-ed410f46-787b-4200-8216-e8678856af7f for instance with vm_state building and task_state spawning.
Jul 25 10:02:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-ed410f46-787b-4200-8216-e8678856af7f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-ed410f46-787b-4200-8216-e8678856af7f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:18 user nova-compute[71312]: WARNING nova.compute.manager [req-bdafa179-3b8f-4c5d-9d47-652ee5f7e15d req-7e2ef31a-d238-477c-ac6e-397272d205e3 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-ed410f46-787b-4200-8216-e8678856af7f for instance with vm_state building and task_state spawning.
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-621e0aaf-d2c9-4269-9085-177fa5e1536b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-621e0aaf-d2c9-4269-9085-177fa5e1536b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:02:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-3dabfadb-6d85-4051-8795-2b23c225c72e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-3dabfadb-6d85-4051-8795-2b23c225c72e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:19 user nova-compute[71312]: WARNING nova.compute.manager [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-3dabfadb-6d85-4051-8795-2b23c225c72e for instance with vm_state building and task_state spawning.
Jul 25 10:02:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-81060ccd-4ba6-4d40-b340-320cfa254f38 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-81060ccd-4ba6-4d40-b340-320cfa254f38 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:19 user nova-compute[71312]: WARNING nova.compute.manager [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-81060ccd-4ba6-4d40-b340-320cfa254f38 for instance with vm_state building and task_state spawning.
Jul 25 10:02:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-81060ccd-4ba6-4d40-b340-320cfa254f38 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-81060ccd-4ba6-4d40-b340-320cfa254f38 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:19 user nova-compute[71312]: WARNING nova.compute.manager [req-85af806b-98e1-4bbb-a855-3806789f0e4f req-0ca2adec-7d50-4f8c-926f-f0c14fdf0537 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-81060ccd-4ba6-4d40-b340-320cfa254f38 for instance with vm_state building and task_state spawning.
Jul 25 10:02:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Updating instance_info_cache with network_info: [{"id": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "address": "fa:16:3e:d0:d2:02", "network": {"id": "6e5b6ffe-9a3e-434f-94bd-7954911aa6e1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-531293470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b99872ef56f4971ba1d5a8aff32ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7d3563-fd", "ovs_interfaceid": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-621e0aaf-d2c9-4269-9085-177fa5e1536b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:02:20 user nova-compute[71312]: INFO nova.compute.manager [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] instance snapshotting
Jul 25 10:02:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Beginning live snapshot process
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-468cbd00-2f81-4c6f-80c4-4561d2d57913 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-468cbd00-2f81-4c6f-80c4-4561d2d57913 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:20 user nova-compute[71312]: WARNING nova.compute.manager [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-468cbd00-2f81-4c6f-80c4-4561d2d57913 for instance with vm_state building and task_state spawning.
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:20 user nova-compute[71312]: WARNING nova.compute.manager [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc for instance with vm_state building and task_state spawning.
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:20 user nova-compute[71312]: WARNING nova.compute.manager [req-028d3cbb-1cd7-4aaa-960d-7509a1fda48d req-95a0b1c4-f9ca-4c7e-9c3c-17a013563990 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc for instance with vm_state building and task_state spawning.
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-3987a8fd-5e25-4f9b-88c0-279e7ee3bad9 req-2932ebd8-6b14-42fc-a7db-b2b0584d341c service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-changed-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-3987a8fd-5e25-4f9b-88c0-279e7ee3bad9 req-2932ebd8-6b14-42fc-a7db-b2b0584d341c service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Refreshing instance network info cache due to event network-changed-c8954e08-0e8d-41ae-9080-1eb363124b32. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3987a8fd-5e25-4f9b-88c0-279e7ee3bad9 req-2932ebd8-6b14-42fc-a7db-b2b0584d341c service nova] Acquiring lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3987a8fd-5e25-4f9b-88c0-279e7ee3bad9 req-2932ebd8-6b14-42fc-a7db-b2b0584d341c service nova] Acquired lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-3987a8fd-5e25-4f9b-88c0-279e7ee3bad9 req-2932ebd8-6b14-42fc-a7db-b2b0584d341c service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Refreshing network info cache for port c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279340.8160226, 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:02:20 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] VM Resumed (Lifecycle Event)
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json -f qcow2" returned: 0 in 0.309s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Instance spawned successfully.
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:02:21 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279340.8376355, 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:02:21 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] VM Started (Lifecycle Event)
Jul 25 10:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.180s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxzf4vga2/5bbbf9b1818f45c395665aae4cfed978.delta 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:21 user nova-compute[71312]: INFO nova.compute.manager [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Took 11.44 seconds to spawn the instance on the hypervisor.
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxzf4vga2/5bbbf9b1818f45c395665aae4cfed978.delta 1073741824" returned: 0 in 0.058s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71312) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 25 10:02:21 user nova-compute[71312]: INFO nova.virt.libvirt.host [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] UEFI support detected
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:02:21 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-5eae3e59-a84e-452e-8b86-3cda0bd53769 req-d036749d-8ad4-4fc8-a326-88c53b12edb0 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-changed-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-5eae3e59-a84e-452e-8b86-3cda0bd53769 req-d036749d-8ad4-4fc8-a326-88c53b12edb0 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Refreshing instance network info cache due to event network-changed-8727a126-c33f-4868-8651-45e7c1f663d2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5eae3e59-a84e-452e-8b86-3cda0bd53769 req-d036749d-8ad4-4fc8-a326-88c53b12edb0 service nova] Acquiring lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5eae3e59-a84e-452e-8b86-3cda0bd53769 req-d036749d-8ad4-4fc8-a326-88c53b12edb0 service nova] Acquired lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-5eae3e59-a84e-452e-8b86-3cda0bd53769 req-d036749d-8ad4-4fc8-a326-88c53b12edb0 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Refreshing network info cache for port 8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:02:21 user nova-compute[71312]: INFO nova.compute.manager [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Took 34.75 seconds to build instance.
Jul 25 10:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-56bd5b99-528d-4a35-ab0c-0b54afeaf5f8 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.887s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-3987a8fd-5e25-4f9b-88c0-279e7ee3bad9 req-2932ebd8-6b14-42fc-a7db-b2b0584d341c service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Updated VIF entry in instance network info cache for port c8954e08-0e8d-41ae-9080-1eb363124b32. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-3987a8fd-5e25-4f9b-88c0-279e7ee3bad9 req-2932ebd8-6b14-42fc-a7db-b2b0584d341c service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Updating instance_info_cache with network_info: [{"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3987a8fd-5e25-4f9b-88c0-279e7ee3bad9 req-2932ebd8-6b14-42fc-a7db-b2b0584d341c service nova] Releasing lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-5eae3e59-a84e-452e-8b86-3cda0bd53769 req-d036749d-8ad4-4fc8-a326-88c53b12edb0 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updated VIF entry in instance network info cache for port 8727a126-c33f-4868-8651-45e7c1f663d2. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-5eae3e59-a84e-452e-8b86-3cda0bd53769 req-d036749d-8ad4-4fc8-a326-88c53b12edb0 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updating instance_info_cache with network_info: [{"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "621e0aaf-d2c9-4269-9085-177fa5e1536b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lazy-loading 'flavor' on Instance uuid 621e0aaf-d2c9-4269-9085-177fa5e1536b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5eae3e59-a84e-452e-8b86-3cda0bd53769 req-d036749d-8ad4-4fc8-a326-88c53b12edb0 service nova] Releasing lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] COPY block job progress, current cursor: 589824 final cursor: 75497472 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "621e0aaf-d2c9-4269-9085-177fa5e1536b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:22 user nova-compute[71312]: INFO nova.compute.manager [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Attaching volume d70852ac-3a3b-4972-b2d4-8bb8fd711539 to /dev/vdb
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG os_brick.utils [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f88b65-bd08-481e-af81-3a6afe949a15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b89405d-f733-4a74-8d72-1293579062b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] COPY block job progress, current cursor: 24444928 final cursor: 75497472 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf0db9c-0666-4c7d-a20f-70a7724cb8aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[858e850b-dad2-4a57-9461-b3f4d2ba4844]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:02:22 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7816ca1-b9c5-49ff-a7e9-67976592915e]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG os_brick.utils [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Updating existing volume attachment record: 21dd2571-f9dc-4634-b529-110eb52cff02 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:02:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 25 10:02:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:23 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:02:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxzf4vga2/5bbbf9b1818f45c395665aae4cfed978.delta /opt/stack/data/nova/instances/snapshots/tmpxzf4vga2/5bbbf9b1818f45c395665aae4cfed978 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxzf4vga2/5bbbf9b1818f45c395665aae4cfed978.delta /opt/stack/data/nova/instances/snapshots/tmpxzf4vga2/5bbbf9b1818f45c395665aae4cfed978" returned: 0 in 0.758s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:24 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Snapshot extracted, beginning image upload
Jul 25 10:02:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'flavor' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.130s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:24 user nova-compute[71312]: INFO nova.compute.manager [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Attaching volume 5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 to /dev/vdb
Jul 25 10:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG os_brick.utils [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-66d3faba-cedc-4ae9-8d68-f1a407d93aea req-cee078b8-4997-496a-b9da-e9b82815b1d0 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-changed-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-66d3faba-cedc-4ae9-8d68-f1a407d93aea req-cee078b8-4997-496a-b9da-e9b82815b1d0 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Refreshing instance network info cache due to event network-changed-d1cb436a-ed84-43ea-a32f-6c08effc60d6. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-66d3faba-cedc-4ae9-8d68-f1a407d93aea req-cee078b8-4997-496a-b9da-e9b82815b1d0 service nova] Acquiring lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-66d3faba-cedc-4ae9-8d68-f1a407d93aea req-cee078b8-4997-496a-b9da-e9b82815b1d0 service nova] Acquired lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-66d3faba-cedc-4ae9-8d68-f1a407d93aea req-cee078b8-4997-496a-b9da-e9b82815b1d0 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Refreshing network info cache for port d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:25 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:02:25 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=6685MB free_disk=25.605182647705078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[15de1e11-11bf-4327-af6b-8f0f1c6b8f53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.033s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2619ab-cc2a-4dc9-8d9d-c7d4574f74b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafa2695-3da6-4632-881d-3ca715d78cda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3175b80-1e2b-4b12-acff-21c295d5a5f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:02:25 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:02:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a47d3b-3ac9-42aa-a363-13c847c3438e]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG os_brick.utils [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Updating existing volume attachment record: 462ec86e-8fa3-4663-b7bb-9a0e42a0e97e {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 621e0aaf-d2c9-4269-9085-177fa5e1536b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9fb85501-6210-4bfd-b496-1891c79fd23c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 297fe407-3797-4681-ba83-e0f296780d57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 50f8683d-8b60-4095-9507-a969c37f85e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance c918b5d0-e8f8-40cc-9c25-71ea69d08756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:02:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:02:26 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:02:26 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:02:26 user nova-compute[71312]: DEBUG nova.network.neutron [req-66d3faba-cedc-4ae9-8d68-f1a407d93aea req-cee078b8-4997-496a-b9da-e9b82815b1d0 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updated VIF entry in instance network info cache for port d1cb436a-ed84-43ea-a32f-6c08effc60d6. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:02:26 user nova-compute[71312]: DEBUG nova.network.neutron [req-66d3faba-cedc-4ae9-8d68-f1a407d93aea req-cee078b8-4997-496a-b9da-e9b82815b1d0 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updating instance_info_cache with network_info: [{"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:02:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-66d3faba-cedc-4ae9-8d68-f1a407d93aea req-cee078b8-4997-496a-b9da-e9b82815b1d0 service nova] Releasing lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:02:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:02:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.862s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:27 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Snapshot image upload complete
Jul 25 10:02:27 user nova-compute[71312]: INFO nova.compute.manager [None req-b9d3d923-81fe-4c7e-b4ce-77f350ae1294 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Took 7.87 seconds to snapshot the instance on the hypervisor.
Jul 25 10:02:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-6c31ed7d-cd2e-41be-9580-d3466b758029 req-9a04bf3d-3573-4874-a000-02be5e04cd2b service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Received event network-changed-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-6c31ed7d-cd2e-41be-9580-d3466b758029 req-9a04bf3d-3573-4874-a000-02be5e04cd2b service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Refreshing instance network info cache due to event network-changed-bf53ba3e-ce75-4c45-bdcf-0135e786ea67. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:02:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6c31ed7d-cd2e-41be-9580-d3466b758029 req-9a04bf3d-3573-4874-a000-02be5e04cd2b service nova] Acquiring lock "refresh_cache-297fe407-3797-4681-ba83-e0f296780d57" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:02:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6c31ed7d-cd2e-41be-9580-d3466b758029 req-9a04bf3d-3573-4874-a000-02be5e04cd2b service nova] Acquired lock "refresh_cache-297fe407-3797-4681-ba83-e0f296780d57" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:02:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-6c31ed7d-cd2e-41be-9580-d3466b758029 req-9a04bf3d-3573-4874-a000-02be5e04cd2b service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Refreshing network info cache for port bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:02:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-6c31ed7d-cd2e-41be-9580-d3466b758029 req-9a04bf3d-3573-4874-a000-02be5e04cd2b service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Updated VIF entry in instance network info cache for port bf53ba3e-ce75-4c45-bdcf-0135e786ea67. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:02:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-6c31ed7d-cd2e-41be-9580-d3466b758029 req-9a04bf3d-3573-4874-a000-02be5e04cd2b service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Updating instance_info_cache with network_info: [{"id": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "address": "fa:16:3e:ea:da:e0", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf53ba3e-ce", "ovs_interfaceid": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:02:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6c31ed7d-cd2e-41be-9580-d3466b758029 req-9a04bf3d-3573-4874-a000-02be5e04cd2b service nova] Releasing lock "refresh_cache-297fe407-3797-4681-ba83-e0f296780d57" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:02:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-04a68aac-3b1b-41ce-900c-33e0f705cbcb req-d8c43ea5-2219-4761-8078-8c33cbee2a7e service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-changed-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-04a68aac-3b1b-41ce-900c-33e0f705cbcb req-d8c43ea5-2219-4761-8078-8c33cbee2a7e service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Refreshing instance network info cache due to event network-changed-63f89ec1-70e3-4e23-ad25-c0f935da374d. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:02:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04a68aac-3b1b-41ce-900c-33e0f705cbcb req-d8c43ea5-2219-4761-8078-8c33cbee2a7e service nova] Acquiring lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:02:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04a68aac-3b1b-41ce-900c-33e0f705cbcb req-d8c43ea5-2219-4761-8078-8c33cbee2a7e service nova] Acquired lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:02:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-04a68aac-3b1b-41ce-900c-33e0f705cbcb req-d8c43ea5-2219-4761-8078-8c33cbee2a7e service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Refreshing network info cache for port 63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:02:31 user nova-compute[71312]: DEBUG nova.network.neutron [req-04a68aac-3b1b-41ce-900c-33e0f705cbcb req-d8c43ea5-2219-4761-8078-8c33cbee2a7e service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Updated VIF entry in instance network info cache for port 63f89ec1-70e3-4e23-ad25-c0f935da374d. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:02:31 user nova-compute[71312]: DEBUG nova.network.neutron [req-04a68aac-3b1b-41ce-900c-33e0f705cbcb req-d8c43ea5-2219-4761-8078-8c33cbee2a7e service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Updating instance_info_cache with network_info: [{"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04a68aac-3b1b-41ce-900c-33e0f705cbcb req-d8c43ea5-2219-4761-8078-8c33cbee2a7e service nova] Releasing lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:02:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:02:31 user nova-compute[71312]: INFO nova.compute.manager [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] instance snapshotting
Jul 25 10:02:31 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Beginning live snapshot process
Jul 25 10:02:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.210s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpchj_mter/9a48cb5888674e0183fb78a1fbd97cef.delta 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpchj_mter/9a48cb5888674e0183fb78a1fbd97cef.delta 1073741824" returned: 0 in 0.048s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:32 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 25 10:02:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GVIHKNSo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:33 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:33 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:33 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[79083753-ffac-4a53-b502-09cb8247e45c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:02:33 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f80782-cfcd-418d-92c9-201f60cc0c1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243] added
Jul 25 10:02:33 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[324e99d6-30b6-4a25-a76a-4adfca3452e1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0925255-9b0c-4812-8d6f-124c4119275e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GVIHKNSo {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GVIHKNSo" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dba738-3a81-40e1-ba9e-8f5cf432852a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GVIHKNSo'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1d95f0-af72-4f84-a762-ae5398562caf]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aa38e0-ad87-41ae-a952-d9f05335bd05]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:33 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:33 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:33 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:33 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:33 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:33 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac154333-ddeb-4ee4-af9b-3851d72f68e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260]
Jul 25 10:02:33 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260] successful.
Jul 25 10:02:33 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39fe4dd-1f85-4f0b-a5f3-f7a05f21f302]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58a34e5-914d-4657-b4cc-106937cb3191]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:33 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:33 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:33 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:33 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:33 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:33 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:33 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:33 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca79da6-5793-4f7d-9c74-d0f105647707]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GVIHKNSo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:02:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] COPY block job progress, current cursor: 26476544 final cursor: 75497472 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:02:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:02:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 25 10:02:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26662303532656230', 'path': '/dev/sde'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662303532656230', 'path': '/dev/sde'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:02:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'flavor' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:34 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:02:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpchj_mter/9a48cb5888674e0183fb78a1fbd97cef.delta /opt/stack/data/nova/instances/snapshots/tmpchj_mter/9a48cb5888674e0183fb78a1fbd97cef {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:02:34 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:02:34 user nova-compute[71312]:   <source dev="/dev/sde"/>
Jul 25 10:02:34 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:02:34 user nova-compute[71312]:   <serial>5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243</serial>
Jul 25 10:02:34 user nova-compute[71312]: </disk>
Jul 25 10:02:34 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpchj_mter/9a48cb5888674e0183fb78a1fbd97cef.delta /opt/stack/data/nova/instances/snapshots/tmpchj_mter/9a48cb5888674e0183fb78a1fbd97cef" returned: 0 in 0.691s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Snapshot extracted, beginning image upload
Jul 25 10:02:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] No VIF found with MAC fa:16:3e:3d:6d:80, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtqJMobK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:35 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:35 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:35 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec145e98-b593-476d-a60c-58a22a7a3923]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:02:35 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8259702-5fce-4371-bc81-08f77e91e9a4 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.460s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8383f4-a8a8-493d-8e8a-506bfd3267e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539] added
Jul 25 10:02:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93cc34f-4d06-469f-9787-d340da457f7a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39f19d7-d4d0-4c9e-8159-c10d2ecc4fcc]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TtqJMobK {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TtqJMobK" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a83aa3-7ccc-4b44-ba6b-1ab50c150559]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TtqJMobK'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a833a290-6fb7-477e-baf4-64d83c9e24d8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8589b64-36cc-4ac0-bc5d-d640e94f0e34]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:35 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:35 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:35 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:35 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:35 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:35 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62dc6e2-3a5c-4b6e-8762-3a11a34cec4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539, portal: 172.16.0.220,3260]
Jul 25 10:02:35 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539, portal: 172.16.0.220,3260] successful.
Jul 25 10:02:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.069s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cccacad-2afa-4bb7-a979-c942768557d0]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "297fe407-3797-4681-ba83-e0f296780d57" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "297fe407-3797-4681-ba83-e0f296780d57" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'flavor' on Instance uuid 297fe407-3797-4681-ba83-e0f296780d57 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[149fc090-84c9-4446-a318-5e7e0623e87b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:35 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:35 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:35 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:35 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 (non-flash)
Jul 25 10:02:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:35 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:35 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:35 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:35 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 (non-flash)
Jul 25 10:02:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac522a43-7f72-4c89-9133-0586058f3459]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtqJMobK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "297fe407-3797-4681-ba83-e0f296780d57" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "297fe407-3797-4681-ba83-e0f296780d57" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "297fe407-3797-4681-ba83-e0f296780d57" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:35 user nova-compute[71312]: INFO nova.compute.manager [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Attaching volume 3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 to /dev/vdb
Jul 25 10:02:36 user nova-compute[71312]: DEBUG os_brick.utils [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[73162cb3-cf01-419c-b5c0-8864fc96ecf3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3bc47fbd-2ff0-4c5a-bf0f-1b0b0b35e63f tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3bc47fbd-2ff0-4c5a-bf0f-1b0b0b35e63f tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3bc47fbd-2ff0-4c5a-bf0f-1b0b0b35e63f tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b300bd19-603f-4314-8aa5-9cc702d89fe1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3bc47fbd-2ff0-4c5a-bf0f-1b0b0b35e63f tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71312) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3341}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3bc47fbd-2ff0-4c5a-bf0f-1b0b0b35e63f tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'flavor' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[16609932-90e0-4ecc-a5aa-38a305063529]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[09477a95-baa8-4fbf-b9a7-c176f60b5ba7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:02:36 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd61f8f7-d9b0-4acf-a731-45b8c006c1b8]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG os_brick.utils [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] <== get_connector_properties: return (403ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Updating existing volume attachment record: b0e13f9b-771e-41ea-ba06-ceab29911380 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26463306163316330', 'path': '/dev/sdf'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463306163316330', 'path': '/dev/sdf'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lazy-loading 'flavor' on Instance uuid 621e0aaf-d2c9-4269-9085-177fa5e1536b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:02:36 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:02:36 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:02:36 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:02:36 user nova-compute[71312]:   <serial>d70852ac-3a3b-4972-b2d4-8bb8fd711539</serial>
Jul 25 10:02:36 user nova-compute[71312]: </disk>
Jul 25 10:02:36 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-f15e36be-7fae-483b-bee3-a85b39098e1a req-f34183a1-2955-4ed3-ae3e-4ac51e937189 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-vif-unplugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f15e36be-7fae-483b-bee3-a85b39098e1a req-f34183a1-2955-4ed3-ae3e-4ac51e937189 service nova] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f15e36be-7fae-483b-bee3-a85b39098e1a req-f34183a1-2955-4ed3-ae3e-4ac51e937189 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f15e36be-7fae-483b-bee3-a85b39098e1a req-f34183a1-2955-4ed3-ae3e-4ac51e937189 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-f15e36be-7fae-483b-bee3-a85b39098e1a req-f34183a1-2955-4ed3-ae3e-4ac51e937189 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] No waiting events found dispatching network-vif-unplugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:36 user nova-compute[71312]: WARNING nova.compute.manager [req-f15e36be-7fae-483b-bee3-a85b39098e1a req-f34183a1-2955-4ed3-ae3e-4ac51e937189 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received unexpected event network-vif-unplugged-c8954e08-0e8d-41ae-9080-1eb363124b32 for instance with vm_state active and task_state powering-off.
Jul 25 10:02:37 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Instance destroyed successfully.
Jul 25 10:02:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3bc47fbd-2ff0-4c5a-bf0f-1b0b0b35e63f tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:02:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3bc47fbd-2ff0-4c5a-bf0f-1b0b0b35e63f tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.571s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:02:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:02:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] No VIF found with MAC fa:16:3e:d0:d2:02, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:02:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9d7b5bc9-6146-4c46-87e7-ba53f43e4fc4 tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.296s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Snapshot image upload complete
Jul 25 10:02:38 user nova-compute[71312]: INFO nova.compute.manager [None req-839e2844-6cd1-445c-93cb-57fb3d5ac9b7 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Took 6.25 seconds to snapshot the instance on the hypervisor.
Jul 25 10:02:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-10267a45-3f6b-42d7-b7ce-770e92388932 req-ff0e28ba-0833-4e95-a450-5dbcce6e5efe service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10267a45-3f6b-42d7-b7ce-770e92388932 req-ff0e28ba-0833-4e95-a450-5dbcce6e5efe service nova] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10267a45-3f6b-42d7-b7ce-770e92388932 req-ff0e28ba-0833-4e95-a450-5dbcce6e5efe service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10267a45-3f6b-42d7-b7ce-770e92388932 req-ff0e28ba-0833-4e95-a450-5dbcce6e5efe service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-10267a45-3f6b-42d7-b7ce-770e92388932 req-ff0e28ba-0833-4e95-a450-5dbcce6e5efe service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] No waiting events found dispatching network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:38 user nova-compute[71312]: WARNING nova.compute.manager [req-10267a45-3f6b-42d7-b7ce-770e92388932 req-ff0e28ba-0833-4e95-a450-5dbcce6e5efe service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received unexpected event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 for instance with vm_state stopped and task_state None.
Jul 25 10:02:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "621e0aaf-d2c9-4269-9085-177fa5e1536b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:39 user nova-compute[71312]: INFO nova.compute.manager [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Terminating instance
Jul 25 10:02:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Instance destroyed successfully.
Jul 25 10:02:39 user nova-compute[71312]: DEBUG nova.objects.instance [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lazy-loading 'resources' on Instance uuid 621e0aaf-d2c9-4269-9085-177fa5e1536b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1643577833',display_name='tempest-DeleteServersTestJSON-server-1643577833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1643577833',id=2,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b99872ef56f4971ba1d5a8aff32ba10',ramdisk_id='',reservation_id='r-1jl1fz4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-227894336',owner_user_name='tempest-DeleteServersTestJSON-227894336-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:00:48Z,user_data=None,user_id='30aeb8024651463b8d1290e405c5fe12',uuid=621e0aaf-d2c9-4269-9085-177fa5e1536b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "address": "fa:16:3e:d0:d2:02", "network": {"id": "6e5b6ffe-9a3e-434f-94bd-7954911aa6e1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-531293470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b99872ef56f4971ba1d5a8aff32ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7d3563-fd", "ovs_interfaceid": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Converting VIF {"id": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "address": "fa:16:3e:d0:d2:02", "network": {"id": "6e5b6ffe-9a3e-434f-94bd-7954911aa6e1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-531293470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b99872ef56f4971ba1d5a8aff32ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd7d3563-fd", "ovs_interfaceid": "dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:d2:02,bridge_name='br-int',has_traffic_filtering=True,id=dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8,network=Network(6e5b6ffe-9a3e-434f-94bd-7954911aa6e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7d3563-fd') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG os_vif [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:d2:02,bridge_name='br-int',has_traffic_filtering=True,id=dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8,network=Network(6e5b6ffe-9a3e-434f-94bd-7954911aa6e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7d3563-fd') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd7d3563-fd, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:39 user nova-compute[71312]: INFO os_vif [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:d2:02,bridge_name='br-int',has_traffic_filtering=True,id=dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8,network=Network(6e5b6ffe-9a3e-434f-94bd-7954911aa6e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd7d3563-fd')
Jul 25 10:02:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtqJMobK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:39 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd4e1e8-4093-4428-87de-8755732ae3f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:02:39 user nova-compute[71312]: No targets found.
Jul 25 10:02:39 user nova-compute[71312]: iSNS:
Jul 25 10:02:39 user nova-compute[71312]: No targets found.
Jul 25 10:02:39 user nova-compute[71312]: STATIC:
Jul 25 10:02:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec
Jul 25 10:02:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:02:39 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:02:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496
Jul 25 10:02:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:02:39 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:02:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343
Jul 25 10:02:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:02:39 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:02:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539
Jul 25 10:02:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:02:39 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:02:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:02:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:02:39 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:02:39 user nova-compute[71312]: FIRMWARE:
Jul 25 10:02:39 user nova-compute[71312]: No targets found.
Jul 25 10:02:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:02:39 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:02:39 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99755c3-8501-488b-b56d-63f2a93652bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6e844a-e1d2-49a7-a84a-9eddea023d88]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:40 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:40 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:40 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:40 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 (non-flash)
Jul 25 10:02:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:40 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:40 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:40 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:40 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 (non-flash)
Jul 25 10:02:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c02c3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539'): ({'sdf'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Removing single pathed devices sdf {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4fb820-7f39-4953-b957-2e4940a08cfa]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[83570cbd-02c7-48d4-b948-2429a21ce925]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Flushing IO for device /dev/sdf {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[111b20f6-5a9b-40d3-808d-4dd84c5a5d8e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fb3ec6-26a0-4aa6-b276-a3514bc823ea]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9acaa0d-6196-4aba-bec8-7be39f214e9e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[00883a99-0679-4ff4-b556-369bff476094]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539, portal: 172.16.0.220,3260]
Jul 25 10:02:40 user nova-compute[71312]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539, portal: 172.16.0.220,3260] successful.
Jul 25 10:02:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70852ac-3a3b-4972-b2d4-8bb8fd711539 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[635cd3e2-4bda-40d8-bf35-ac4d38c22730]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] <== disconnect_volume: return (372ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:02:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Deleting instance files /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b_del
Jul 25 10:02:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Deletion of /opt/stack/data/nova/instances/621e0aaf-d2c9-4269-9085-177fa5e1536b_del complete
Jul 25 10:02:40 user nova-compute[71312]: INFO nova.compute.manager [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Took 1.32 seconds to destroy the instance on the hypervisor.
Jul 25 10:02:40 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:02:40 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-d03af636-099e-4b6d-a92b-f930a817dc29 req-2032c713-cef7-477a-942e-7043f9a1c3ba service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Received event network-vif-unplugged-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d03af636-099e-4b6d-a92b-f930a817dc29 req-2032c713-cef7-477a-942e-7043f9a1c3ba service nova] Acquiring lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d03af636-099e-4b6d-a92b-f930a817dc29 req-2032c713-cef7-477a-942e-7043f9a1c3ba service nova] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d03af636-099e-4b6d-a92b-f930a817dc29 req-2032c713-cef7-477a-942e-7043f9a1c3ba service nova] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-d03af636-099e-4b6d-a92b-f930a817dc29 req-2032c713-cef7-477a-942e-7043f9a1c3ba service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] No waiting events found dispatching network-vif-unplugged-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-d03af636-099e-4b6d-a92b-f930a817dc29 req-2032c713-cef7-477a-942e-7043f9a1c3ba service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Received event network-vif-unplugged-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-d03af636-099e-4b6d-a92b-f930a817dc29 req-2032c713-cef7-477a-942e-7043f9a1c3ba service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Received event network-vif-plugged-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d03af636-099e-4b6d-a92b-f930a817dc29 req-2032c713-cef7-477a-942e-7043f9a1c3ba service nova] Acquiring lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d03af636-099e-4b6d-a92b-f930a817dc29 req-2032c713-cef7-477a-942e-7043f9a1c3ba service nova] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d03af636-099e-4b6d-a92b-f930a817dc29 req-2032c713-cef7-477a-942e-7043f9a1c3ba service nova] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-d03af636-099e-4b6d-a92b-f930a817dc29 req-2032c713-cef7-477a-942e-7043f9a1c3ba service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] No waiting events found dispatching network-vif-plugged-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:41 user nova-compute[71312]: WARNING nova.compute.manager [req-d03af636-099e-4b6d-a92b-f930a817dc29 req-2032c713-cef7-477a-942e-7043f9a1c3ba service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Received unexpected event network-vif-plugged-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 for instance with vm_state active and task_state deleting.
Jul 25 10:02:41 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:02:41 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Took 0.79 seconds to deallocate network for instance.
Jul 25 10:02:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-d0b7dfcc-7671-470e-942a-2c274c00de93 req-d30c674d-c860-444d-9bc0-92c203592fff service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Received event network-changed-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-d0b7dfcc-7671-470e-942a-2c274c00de93 req-d30c674d-c860-444d-9bc0-92c203592fff service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Refreshing instance network info cache due to event network-changed-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d0b7dfcc-7671-470e-942a-2c274c00de93 req-d30c674d-c860-444d-9bc0-92c203592fff service nova] Acquiring lock "refresh_cache-50f8683d-8b60-4095-9507-a969c37f85e2" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d0b7dfcc-7671-470e-942a-2c274c00de93 req-d30c674d-c860-444d-9bc0-92c203592fff service nova] Acquired lock "refresh_cache-50f8683d-8b60-4095-9507-a969c37f85e2" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-d0b7dfcc-7671-470e-942a-2c274c00de93 req-d30c674d-c860-444d-9bc0-92c203592fff service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Refreshing network info cache for port 0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-d0b7dfcc-7671-470e-942a-2c274c00de93 req-d30c674d-c860-444d-9bc0-92c203592fff service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Updated VIF entry in instance network info cache for port 0643c7ae-df24-43ff-8a02-2d4bd1f1cb39. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-d0b7dfcc-7671-470e-942a-2c274c00de93 req-d30c674d-c860-444d-9bc0-92c203592fff service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Updating instance_info_cache with network_info: [{"id": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "address": "fa:16:3e:5d:33:72", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643c7ae-df", "ovs_interfaceid": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d0b7dfcc-7671-470e-942a-2c274c00de93 req-d30c674d-c860-444d-9bc0-92c203592fff service nova] Releasing lock "refresh_cache-50f8683d-8b60-4095-9507-a969c37f85e2" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:02:42 user nova-compute[71312]: INFO nova.compute.manager [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Took 1.13 seconds to detach 1 volumes for instance.
Jul 25 10:02:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:42 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:02:42 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:02:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:42 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Deleted allocations for instance 621e0aaf-d2c9-4269-9085-177fa5e1536b
Jul 25 10:02:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35b80523-14dc-4a1b-a237-5402bd8db54d tempest-DeleteServersTestJSON-227894336 tempest-DeleteServersTestJSON-227894336-project-member] Lock "621e0aaf-d2c9-4269-9085-177fa5e1536b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.893s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-7465f3bb-aaf7-4a49-aaff-f497f3f902f6 req-211f75e7-8cd5-4e2b-9e22-46544f9b1aa5 service nova] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Received event network-vif-deleted-dd7d3563-fdce-48cf-a4b7-80ff1cfcc1a8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVcJqHjt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:44 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:44 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:44 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[150c3cd4-cc59-4a38-8172-0595d6d2fb67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:02:44 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "50f8683d-8b60-4095-9507-a969c37f85e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "50f8683d-8b60-4095-9507-a969c37f85e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[19419c04-e443-4d0f-87b9-c6eba9c736c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9] added
Jul 25 10:02:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lazy-loading 'flavor' on Instance uuid 50f8683d-8b60-4095-9507-a969c37f85e2 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d87807-79d1-4340-b0c9-7358be41c157]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4af1835-81e8-4abb-b573-8df2cf0fddbb]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVcJqHjt {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "50f8683d-8b60-4095-9507-a969c37f85e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVcJqHjt" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9b498b-8dd9-403e-a5c1-5bd2b763720e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AVcJqHjt'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a96f35-bccb-4157-a9de-0fe006d64dcd]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec73598b-87ca-470f-bbc6-1d54eb7c722a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:44 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:44 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:44 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:44 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:44 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:44 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "50f8683d-8b60-4095-9507-a969c37f85e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "50f8683d-8b60-4095-9507-a969c37f85e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:44 user nova-compute[71312]: INFO nova.compute.manager [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Attaching volume 242d90aa-1f27-4dad-bef9-d06262b6c548 to /dev/vdb
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a660358-bc54-43f5-b8c9-45412007e085]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9, portal: 172.16.0.220,3260]
Jul 25 10:02:44 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9, portal: 172.16.0.220,3260] successful.
Jul 25 10:02:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b64b56-5e29-4caa-9770-ea026cc5a649]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.utils [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4affad62-22a9-4558-a524-d7a922749caa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:44 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:44 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:44 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:44 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:02:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:44 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:44 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:44 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:44 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:02:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa8b248-da45-4006-89bb-adc35b71eca5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[005d76f0-c7e3-4db1-ae3f-0c58043bff1f]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVcJqHjt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb43337-32c1-4f1b-b161-3ddceffdfd80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba272ff4-a679-414f-9fa2-a0268ffbb758]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3464bdd-2a6a-4f57-bdfa-6f7a298199c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:02:44 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:02:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab229a7-1dea-4746-ba0b-56a83d1793a9]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG os_brick.utils [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Updating existing volume attachment record: 6f087bc8-9be9-4b79-a07b-6b693b48e6f8 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:02:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23362626136373866', 'path': '/dev/sdf'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362626136373866', 'path': '/dev/sdf'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:02:45 user nova-compute[71312]: DEBUG nova.objects.instance [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'flavor' on Instance uuid 297fe407-3797-4681-ba83-e0f296780d57 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:02:45 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:02:45 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:02:45 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:02:45 user nova-compute[71312]:   <serial>3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9</serial>
Jul 25 10:02:45 user nova-compute[71312]: </disk>
Jul 25 10:02:45 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:02:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:02:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:02:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No VIF found with MAC fa:16:3e:ea:da:e0, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:02:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-11aeeadf-5cac-43d5-83f3-9f8775b14e12 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "297fe407-3797-4681-ba83-e0f296780d57" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.156s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:02:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:02:49 user nova-compute[71312]: INFO nova.compute.claims [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Claim successful on node user
Jul 25 10:02:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:49 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:02:49 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG nova.network.neutron [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:02:50 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:02:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG nova.policy [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fe1a69013de4b4dbcb98a35e48d8ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a09fcc394c945c2b843abf3df53cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:02:50 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Creating image(s)
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "/opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "/opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk 1073741824" returned: 0 in 0.118s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG nova.network.neutron [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Successfully created port: f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Cannot resize image /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG nova.objects.instance [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'migration_context' on Instance uuid 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Ensure instance console log exists: /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxpbMdTA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:51 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:51 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:51 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6288ef11-55bb-4228-bcca-750ffdf34052]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:02:51 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Successfully updated port: f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29e7aa2-603d-4418-b9d1-4c7d0280541c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548] added
Jul 25 10:02:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "refresh_cache-7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquired lock "refresh_cache-7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[222b38a1-ed55-45dd-9da5-25cf2ef28294]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-c823b0ce-b336-408a-b762-173856b10df7 req-aa115cdf-0e2c-491b-ba2d-0a8f598ecf1a service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Received event network-changed-f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-c823b0ce-b336-408a-b762-173856b10df7 req-aa115cdf-0e2c-491b-ba2d-0a8f598ecf1a service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Refreshing instance network info cache due to event network-changed-f8b6315a-f86a-4616-97e3-647c1d6fdca7. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c823b0ce-b336-408a-b762-173856b10df7 req-aa115cdf-0e2c-491b-ba2d-0a8f598ecf1a service nova] Acquiring lock "refresh_cache-7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dfb8b2-562e-4fc6-b8ca-eb80c6e912bf]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxpbMdTA {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxpbMdTA" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8a7ecb-7976-44bf-9fd1-f9e15d72e603]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FxpbMdTA'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9183291-b4d8-4492-ba83-487d38d2e56d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[89df2ad6-5e3d-48c8-99ac-bac7b595392e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf9d06f-629f-421f-9484-809859de604b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548, portal: 172.16.0.220,3260]
Jul 25 10:02:51 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548, portal: 172.16.0.220,3260] successful.
Jul 25 10:02:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b50ea83-095b-4e49-ae76-c023809f0cc4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dc146b-2239-4957-b60d-89e681c0e5f5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 (non-flash)
Jul 25 10:02:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-8ee7e75b-be56-441d-b06e-460f05835061 req-a3fc0ebd-6347-4102-a258-4973ac61ffe3 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received event network-changed-682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-8ee7e75b-be56-441d-b06e-460f05835061 req-a3fc0ebd-6347-4102-a258-4973ac61ffe3 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Refreshing instance network info cache due to event network-changed-682fce50-406a-4315-b5fc-b434a6c7c890. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8ee7e75b-be56-441d-b06e-460f05835061 req-a3fc0ebd-6347-4102-a258-4973ac61ffe3 service nova] Acquiring lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8ee7e75b-be56-441d-b06e-460f05835061 req-a3fc0ebd-6347-4102-a258-4973ac61ffe3 service nova] Acquired lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG nova.network.neutron [req-8ee7e75b-be56-441d-b06e-460f05835061 req-a3fc0ebd-6347-4102-a258-4973ac61ffe3 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Refreshing network info cache for port 682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[986e4257-071c-4273-b41e-8b6178642b17]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:02:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxpbMdTA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.network.neutron [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Updating instance_info_cache with network_info: [{"id": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "address": "fa:16:3e:55:18:b7", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b6315a-f8", "ovs_interfaceid": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Releasing lock "refresh_cache-7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Instance network_info: |[{"id": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "address": "fa:16:3e:55:18:b7", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b6315a-f8", "ovs_interfaceid": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c823b0ce-b336-408a-b762-173856b10df7 req-aa115cdf-0e2c-491b-ba2d-0a8f598ecf1a service nova] Acquired lock "refresh_cache-7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.network.neutron [req-c823b0ce-b336-408a-b762-173856b10df7 req-aa115cdf-0e2c-491b-ba2d-0a8f598ecf1a service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Refreshing network info cache for port f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Start _get_guest_xml network_info=[{"id": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "address": "fa:16:3e:55:18:b7", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b6315a-f8", "ovs_interfaceid": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:02:52 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:02:52 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-815665361',display_name='tempest-AttachVolumeNegativeTest-server-815665361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-815665361',id=12,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIb5nxWzSLVfQqLVyGp2qTyDyfZG1UBm0cAeYpLivZSEi8qg9ZvhfaN+ekQILTgjvZvGXCZLbQOhOeYBsQSXOm5DyX2MQNBaYkwlqhd8UQs9sWy/MwW979NkgJtQ0X6Og==',key_name='tempest-keypair-37618991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a09fcc394c945c2b843abf3df53cda6',ramdisk_id='',reservation_id='r-yl0b5ckj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016049404',owner_user_name='tempest-AttachVolumeNegativeTest-1016049404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe1a69013de4b4dbcb98a35e48d8ee8',uuid=7c1d967c-cb20-4204-a0aa-d9ec4ecde09e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "address": "fa:16:3e:55:18:b7", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b6315a-f8", "ovs_interfaceid": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converting VIF {"id": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "address": "fa:16:3e:55:18:b7", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b6315a-f8", "ovs_interfaceid": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:18:b7,bridge_name='br-int',has_traffic_filtering=True,id=f8b6315a-f86a-4616-97e3-647c1d6fdca7,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b6315a-f8') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:02:52 user nova-compute[71312]:   <uuid>7c1d967c-cb20-4204-a0aa-d9ec4ecde09e</uuid>
Jul 25 10:02:52 user nova-compute[71312]:   <name>instance-0000000c</name>
Jul 25 10:02:52 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:02:52 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:02:52 user nova-compute[71312]:   <metadata>
Jul 25 10:02:52 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:02:52 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:02:52 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeNegativeTest-server-815665361</nova:name>
Jul 25 10:02:52 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:02:52</nova:creationTime>
Jul 25 10:02:52 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:02:52 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:02:52 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:02:52 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:02:52 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:02:52 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:02:52 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:02:52 user nova-compute[71312]:       <nova:owner>
Jul 25 10:02:52 user nova-compute[71312]:         <nova:user uuid="3fe1a69013de4b4dbcb98a35e48d8ee8">tempest-AttachVolumeNegativeTest-1016049404-project-member</nova:user>
Jul 25 10:02:52 user nova-compute[71312]:         <nova:project uuid="0a09fcc394c945c2b843abf3df53cda6">tempest-AttachVolumeNegativeTest-1016049404</nova:project>
Jul 25 10:02:52 user nova-compute[71312]:       </nova:owner>
Jul 25 10:02:52 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:02:52 user nova-compute[71312]:       <nova:ports>
Jul 25 10:02:52 user nova-compute[71312]:         <nova:port uuid="f8b6315a-f86a-4616-97e3-647c1d6fdca7">
Jul 25 10:02:52 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 10:02:52 user nova-compute[71312]:         </nova:port>
Jul 25 10:02:52 user nova-compute[71312]:       </nova:ports>
Jul 25 10:02:52 user nova-compute[71312]:     </nova:instance>
Jul 25 10:02:52 user nova-compute[71312]:   </metadata>
Jul 25 10:02:52 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:02:52 user nova-compute[71312]:     <system>
Jul 25 10:02:52 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:02:52 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:02:52 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:02:52 user nova-compute[71312]:       <entry name="serial">7c1d967c-cb20-4204-a0aa-d9ec4ecde09e</entry>
Jul 25 10:02:52 user nova-compute[71312]:       <entry name="uuid">7c1d967c-cb20-4204-a0aa-d9ec4ecde09e</entry>
Jul 25 10:02:52 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:02:52 user nova-compute[71312]:     </system>
Jul 25 10:02:52 user nova-compute[71312]:   </sysinfo>
Jul 25 10:02:52 user nova-compute[71312]:   <os>
Jul 25 10:02:52 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:02:52 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:02:52 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:02:52 user nova-compute[71312]:   </os>
Jul 25 10:02:52 user nova-compute[71312]:   <features>
Jul 25 10:02:52 user nova-compute[71312]:     <acpi/>
Jul 25 10:02:52 user nova-compute[71312]:     <apic/>
Jul 25 10:02:52 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:02:52 user nova-compute[71312]:   </features>
Jul 25 10:02:52 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:02:52 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:02:52 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:02:52 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:02:52 user nova-compute[71312]:   </clock>
Jul 25 10:02:52 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:02:52 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:02:52 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:02:52 user nova-compute[71312]:   </cpu>
Jul 25 10:02:52 user nova-compute[71312]:   <devices>
Jul 25 10:02:52 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:02:52 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:02:52 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk"/>
Jul 25 10:02:52 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:02:52 user nova-compute[71312]:     </disk>
Jul 25 10:02:52 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:02:52 user nova-compute[71312]:       <mac address="fa:16:3e:55:18:b7"/>
Jul 25 10:02:52 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:02:52 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:02:52 user nova-compute[71312]:       <target dev="tapf8b6315a-f8"/>
Jul 25 10:02:52 user nova-compute[71312]:     </interface>
Jul 25 10:02:52 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:02:52 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/console.log" append="off"/>
Jul 25 10:02:52 user nova-compute[71312]:     </serial>
Jul 25 10:02:52 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:02:52 user nova-compute[71312]:     <video>
Jul 25 10:02:52 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:02:52 user nova-compute[71312]:     </video>
Jul 25 10:02:52 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:02:52 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:02:52 user nova-compute[71312]:     </rng>
Jul 25 10:02:52 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:02:52 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:02:52 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:02:52 user nova-compute[71312]:     </memballoon>
Jul 25 10:02:52 user nova-compute[71312]:   </devices>
Jul 25 10:02:52 user nova-compute[71312]: </domain>
Jul 25 10:02:52 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-815665361',display_name='tempest-AttachVolumeNegativeTest-server-815665361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-815665361',id=12,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIb5nxWzSLVfQqLVyGp2qTyDyfZG1UBm0cAeYpLivZSEi8qg9ZvhfaN+ekQILTgjvZvGXCZLbQOhOeYBsQSXOm5DyX2MQNBaYkwlqhd8UQs9sWy/MwW979NkgJtQ0X6Og==',key_name='tempest-keypair-37618991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a09fcc394c945c2b843abf3df53cda6',ramdisk_id='',reservation_id='r-yl0b5ckj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016049404',owner_user_name='tempest-AttachVolumeNegativeTest-1016049404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe1a69013de4b4dbcb98a35e48d8ee8',uuid=7c1d967c-cb20-4204-a0aa-d9ec4ecde09e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "address": "fa:16:3e:55:18:b7", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b6315a-f8", "ovs_interfaceid": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converting VIF {"id": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "address": "fa:16:3e:55:18:b7", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b6315a-f8", "ovs_interfaceid": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:18:b7,bridge_name='br-int',has_traffic_filtering=True,id=f8b6315a-f86a-4616-97e3-647c1d6fdca7,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b6315a-f8') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG os_vif [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:18:b7,bridge_name='br-int',has_traffic_filtering=True,id=f8b6315a-f86a-4616-97e3-647c1d6fdca7,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b6315a-f8') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8b6315a-f8, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf8b6315a-f8, col_values=(('external_ids', {'iface-id': 'f8b6315a-f86a-4616-97e3-647c1d6fdca7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:18:b7', 'vm-uuid': '7c1d967c-cb20-4204-a0aa-d9ec4ecde09e'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:52 user nova-compute[71312]: INFO os_vif [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:18:b7,bridge_name='br-int',has_traffic_filtering=True,id=f8b6315a-f86a-4616-97e3-647c1d6fdca7,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b6315a-f8')
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No VIF found with MAC fa:16:3e:55:18:b7, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "interface-c918b5d0-e8f8-40cc-9c25-71ea69d08756-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "interface-c918b5d0-e8f8-40cc-9c25-71ea69d08756-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lazy-loading 'flavor' on Instance uuid c918b5d0-e8f8-40cc-9c25-71ea69d08756 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.network.neutron [req-8ee7e75b-be56-441d-b06e-460f05835061 req-a3fc0ebd-6347-4102-a258-4973ac61ffe3 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Updated VIF entry in instance network info cache for port 682fce50-406a-4315-b5fc-b434a6c7c890. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.network.neutron [req-8ee7e75b-be56-441d-b06e-460f05835061 req-a3fc0ebd-6347-4102-a258-4973ac61ffe3 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Updating instance_info_cache with network_info: [{"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.network.neutron [req-c823b0ce-b336-408a-b762-173856b10df7 req-aa115cdf-0e2c-491b-ba2d-0a8f598ecf1a service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Updated VIF entry in instance network info cache for port f8b6315a-f86a-4616-97e3-647c1d6fdca7. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.network.neutron [req-c823b0ce-b336-408a-b762-173856b10df7 req-aa115cdf-0e2c-491b-ba2d-0a8f598ecf1a service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Updating instance_info_cache with network_info: [{"id": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "address": "fa:16:3e:55:18:b7", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b6315a-f8", "ovs_interfaceid": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279357.5154164, a35abe6a-0a8b-4eb2-8781-85b99539d1fc => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:02:52 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] VM Stopped (Lifecycle Event)
Jul 25 10:02:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8ee7e75b-be56-441d-b06e-460f05835061 req-a3fc0ebd-6347-4102-a258-4973ac61ffe3 service nova] Releasing lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c823b0ce-b336-408a-b762-173856b10df7 req-aa115cdf-0e2c-491b-ba2d-0a8f598ecf1a service nova] Releasing lock "refresh_cache-7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6fdc0a97-13e8-42cc-a5a5-df9fb9056dca None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6fdc0a97-13e8-42cc-a5a5-df9fb9056dca None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lazy-loading 'pci_requests' on Instance uuid c918b5d0-e8f8-40cc-9c25-71ea69d08756 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.policy [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6325c3b752a4cd88b584d9acd06d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5086ef6cce4cdfafc4a061ab06f894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23461306131383363', 'path': '/dev/sdg'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461306131383363', 'path': '/dev/sdg'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:02:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lazy-loading 'flavor' on Instance uuid 50f8683d-8b60-4095-9507-a969c37f85e2 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:02:53 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:02:53 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:02:53 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:02:53 user nova-compute[71312]:   <serial>242d90aa-1f27-4dad-bef9-d06262b6c548</serial>
Jul 25 10:02:53 user nova-compute[71312]: </disk>
Jul 25 10:02:53 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:02:53 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Successfully created port: ab8bcb60-9a8d-45e3-98cf-16703689f2e1 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:02:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:02:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:02:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] No VIF found with MAC fa:16:3e:5d:33:72, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:02:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7039f990-22f0-4671-b1a1-2b5139a1f86d tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "50f8683d-8b60-4095-9507-a969c37f85e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.483s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:53 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Successfully updated port: ab8bcb60-9a8d-45e3-98cf-16703689f2e1 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:02:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:02:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquired lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:02:53 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:02:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-3e6faa2b-fe68-4324-998d-c83e91603392 req-7f54c65d-5685-4ade-88a0-d90ae0e3d381 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received event network-changed-ab8bcb60-9a8d-45e3-98cf-16703689f2e1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-3e6faa2b-fe68-4324-998d-c83e91603392 req-7f54c65d-5685-4ade-88a0-d90ae0e3d381 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Refreshing instance network info cache due to event network-changed-ab8bcb60-9a8d-45e3-98cf-16703689f2e1. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3e6faa2b-fe68-4324-998d-c83e91603392 req-7f54c65d-5685-4ade-88a0-d90ae0e3d381 service nova] Acquiring lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-3a2961f5-48a4-41ac-a1c3-d151a52f2673 req-871d8037-fc7d-4d01-9677-d060ca033fb6 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Received event network-vif-plugged-f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3a2961f5-48a4-41ac-a1c3-d151a52f2673 req-871d8037-fc7d-4d01-9677-d060ca033fb6 service nova] Acquiring lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3a2961f5-48a4-41ac-a1c3-d151a52f2673 req-871d8037-fc7d-4d01-9677-d060ca033fb6 service nova] Lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3a2961f5-48a4-41ac-a1c3-d151a52f2673 req-871d8037-fc7d-4d01-9677-d060ca033fb6 service nova] Lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-3a2961f5-48a4-41ac-a1c3-d151a52f2673 req-871d8037-fc7d-4d01-9677-d060ca033fb6 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] No waiting events found dispatching network-vif-plugged-f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:54 user nova-compute[71312]: WARNING nova.compute.manager [req-3a2961f5-48a4-41ac-a1c3-d151a52f2673 req-871d8037-fc7d-4d01-9677-d060ca033fb6 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Received unexpected event network-vif-plugged-f8b6315a-f86a-4616-97e3-647c1d6fdca7 for instance with vm_state building and task_state spawning.
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Updating instance_info_cache with network_info: [{"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "address": "fa:16:3e:df:13:71", "network": {"id": "75cf6071-7351-481a-8cf4-bf1c01ecc586", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1467023115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8bcb60-9a", "ovs_interfaceid": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Releasing lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3e6faa2b-fe68-4324-998d-c83e91603392 req-7f54c65d-5685-4ade-88a0-d90ae0e3d381 service nova] Acquired lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.network.neutron [req-3e6faa2b-fe68-4324-998d-c83e91603392 req-7f54c65d-5685-4ade-88a0-d90ae0e3d381 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Refreshing network info cache for port ab8bcb60-9a8d-45e3-98cf-16703689f2e1 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-282503515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-282503515',id=9,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfqLhAiM/fPqXox/lYYvHbsORMvG7EmhROMdWtJDW0gFjkybugS0JoPzqPg5A//Q1NyXk2q9pHeiid5wc4meqjPqIfzYlQ74CfLabiQCTkCNSfq5sY3vsH1zVkcnvVCvw==',key_name='tempest-keypair-791003982',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:01:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5b5086ef6cce4cdfafc4a061ab06f894',ramdisk_id='',reservation_id='r-g6z0fs1a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1298550074',owner_user_name='tempest-TaggedAttachmentsTest-1298550074-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6325c3b752a4cd88b584d9acd06d537',uuid=c918b5d0-e8f8-40cc-9c25-71ea69d08756,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "address": "fa:16:3e:df:13:71", "network": {"id": "75cf6071-7351-481a-8cf4-bf1c01ecc586", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1467023115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8bcb60-9a", "ovs_interfaceid": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Converting VIF {"id": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "address": "fa:16:3e:df:13:71", "network": {"id": "75cf6071-7351-481a-8cf4-bf1c01ecc586", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1467023115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8bcb60-9a", "ovs_interfaceid": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:13:71,bridge_name='br-int',has_traffic_filtering=True,id=ab8bcb60-9a8d-45e3-98cf-16703689f2e1,network=Network(75cf6071-7351-481a-8cf4-bf1c01ecc586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8bcb60-9a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG os_vif [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:13:71,bridge_name='br-int',has_traffic_filtering=True,id=ab8bcb60-9a8d-45e3-98cf-16703689f2e1,network=Network(75cf6071-7351-481a-8cf4-bf1c01ecc586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8bcb60-9a') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab8bcb60-9a, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapab8bcb60-9a, col_values=(('external_ids', {'iface-id': 'ab8bcb60-9a8d-45e3-98cf-16703689f2e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:13:71', 'vm-uuid': 'c918b5d0-e8f8-40cc-9c25-71ea69d08756'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:54 user nova-compute[71312]: INFO os_vif [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:13:71,bridge_name='br-int',has_traffic_filtering=True,id=ab8bcb60-9a8d-45e3-98cf-16703689f2e1,network=Network(75cf6071-7351-481a-8cf4-bf1c01ecc586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8bcb60-9a')
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-282503515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-282503515',id=9,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfqLhAiM/fPqXox/lYYvHbsORMvG7EmhROMdWtJDW0gFjkybugS0JoPzqPg5A//Q1NyXk2q9pHeiid5wc4meqjPqIfzYlQ74CfLabiQCTkCNSfq5sY3vsH1zVkcnvVCvw==',key_name='tempest-keypair-791003982',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:01:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5b5086ef6cce4cdfafc4a061ab06f894',ramdisk_id='',reservation_id='r-g6z0fs1a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1298550074',owner_user_name='tempest-TaggedAttachmentsTest-1298550074-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6325c3b752a4cd88b584d9acd06d537',uuid=c918b5d0-e8f8-40cc-9c25-71ea69d08756,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "address": "fa:16:3e:df:13:71", "network": {"id": "75cf6071-7351-481a-8cf4-bf1c01ecc586", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1467023115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8bcb60-9a", "ovs_interfaceid": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Converting VIF {"id": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "address": "fa:16:3e:df:13:71", "network": {"id": "75cf6071-7351-481a-8cf4-bf1c01ecc586", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1467023115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8bcb60-9a", "ovs_interfaceid": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:13:71,bridge_name='br-int',has_traffic_filtering=True,id=ab8bcb60-9a8d-45e3-98cf-16703689f2e1,network=Network(75cf6071-7351-481a-8cf4-bf1c01ecc586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8bcb60-9a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] attach device xml: <interface type="ethernet">
Jul 25 10:02:54 user nova-compute[71312]:   <mac address="fa:16:3e:df:13:71"/>
Jul 25 10:02:54 user nova-compute[71312]:   <model type="virtio"/>
Jul 25 10:02:54 user nova-compute[71312]:   <mtu size="1442"/>
Jul 25 10:02:54 user nova-compute[71312]:   <target dev="tapab8bcb60-9a"/>
Jul 25 10:02:54 user nova-compute[71312]: </interface>
Jul 25 10:02:54 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279359.8564687, 621e0aaf-d2c9-4269-9085-177fa5e1536b => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:02:54 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] VM Stopped (Lifecycle Event)
Jul 25 10:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6fd93226-348c-4fb5-9c76-f17e39053b1c None None] [instance: 621e0aaf-d2c9-4269-9085-177fa5e1536b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "50f8683d-8b60-4095-9507-a969c37f85e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "50f8683d-8b60-4095-9507-a969c37f85e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:55 user nova-compute[71312]: INFO nova.compute.manager [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Detaching volume 242d90aa-1f27-4dad-bef9-d06262b6c548
Jul 25 10:02:55 user nova-compute[71312]: INFO nova.virt.block_device [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Attempting to driver detach volume 242d90aa-1f27-4dad-bef9-d06262b6c548 from mountpoint /dev/vdb
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Attempting to detach device vdb from instance 50f8683d-8b60-4095-9507-a969c37f85e2 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:02:55 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:02:55 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:02:55 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:02:55 user nova-compute[71312]:   <serial>242d90aa-1f27-4dad-bef9-d06262b6c548</serial>
Jul 25 10:02:55 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:02:55 user nova-compute[71312]: </disk>
Jul 25 10:02:55 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] No BDM found with device name hda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] No VIF found with MAC fa:16:3e:4a:96:ef, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:02:55 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Successfully detached device vdb from instance 50f8683d-8b60-4095-9507-a969c37f85e2 from the persistent domain config.
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 50f8683d-8b60-4095-9507-a969c37f85e2 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:02:55 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:02:55 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:02:55 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:02:55 user nova-compute[71312]:   <serial>242d90aa-1f27-4dad-bef9-d06262b6c548</serial>
Jul 25 10:02:55 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:02:55 user nova-compute[71312]: </disk>
Jul 25 10:02:55 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:02:55 user nova-compute[71312]:   <nova:package version="0.0.0"/>
Jul 25 10:02:55 user nova-compute[71312]:   <nova:name>tempest-device-tagging-server-282503515</nova:name>
Jul 25 10:02:55 user nova-compute[71312]:   <nova:creationTime>2023-07-25 10:02:55</nova:creationTime>
Jul 25 10:02:55 user nova-compute[71312]:   <nova:flavor name="m1.tiny">
Jul 25 10:02:55 user nova-compute[71312]:     <nova:memory>512</nova:memory>
Jul 25 10:02:55 user nova-compute[71312]:     <nova:disk>1</nova:disk>
Jul 25 10:02:55 user nova-compute[71312]:     <nova:swap>0</nova:swap>
Jul 25 10:02:55 user nova-compute[71312]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:02:55 user nova-compute[71312]:     <nova:vcpus>1</nova:vcpus>
Jul 25 10:02:55 user nova-compute[71312]:   </nova:flavor>
Jul 25 10:02:55 user nova-compute[71312]:   <nova:owner>
Jul 25 10:02:55 user nova-compute[71312]:     <nova:user uuid="d6325c3b752a4cd88b584d9acd06d537">tempest-TaggedAttachmentsTest-1298550074-project-member</nova:user>
Jul 25 10:02:55 user nova-compute[71312]:     <nova:project uuid="5b5086ef6cce4cdfafc4a061ab06f894">tempest-TaggedAttachmentsTest-1298550074</nova:project>
Jul 25 10:02:55 user nova-compute[71312]:   </nova:owner>
Jul 25 10:02:55 user nova-compute[71312]:   <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:02:55 user nova-compute[71312]:   <nova:ports>
Jul 25 10:02:55 user nova-compute[71312]:     <nova:port uuid="682fce50-406a-4315-b5fc-b434a6c7c890">
Jul 25 10:02:55 user nova-compute[71312]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:02:55 user nova-compute[71312]:     </nova:port>
Jul 25 10:02:55 user nova-compute[71312]:     <nova:port uuid="ab8bcb60-9a8d-45e3-98cf-16703689f2e1">
Jul 25 10:02:55 user nova-compute[71312]:       <nova:ip type="fixed" address="10.10.10.243" ipVersion="4"/>
Jul 25 10:02:55 user nova-compute[71312]:     </nova:port>
Jul 25 10:02:55 user nova-compute[71312]:   </nova:ports>
Jul 25 10:02:55 user nova-compute[71312]: </nova:instance>
Jul 25 10:02:55 user nova-compute[71312]:  {{(pid=71312) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-663637f1-639e-499d-8c85-8f7f597329f1 req-9f82f33d-74ff-49ef-9efc-169e2e3c01fb service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Received event network-changed-1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-663637f1-639e-499d-8c85-8f7f597329f1 req-9f82f33d-74ff-49ef-9efc-169e2e3c01fb service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Refreshing instance network info cache due to event network-changed-1022b294-bd18-485e-a79a-25d9a11b6e42. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-663637f1-639e-499d-8c85-8f7f597329f1 req-9f82f33d-74ff-49ef-9efc-169e2e3c01fb service nova] Acquiring lock "refresh_cache-d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-663637f1-639e-499d-8c85-8f7f597329f1 req-9f82f33d-74ff-49ef-9efc-169e2e3c01fb service nova] Acquired lock "refresh_cache-d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.network.neutron [req-663637f1-639e-499d-8c85-8f7f597329f1 req-9f82f33d-74ff-49ef-9efc-169e2e3c01fb service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Refreshing network info cache for port 1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f186c99a-6bb5-41f9-83b5-29f6f59e0493 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "interface-c918b5d0-e8f8-40cc-9c25-71ea69d08756-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.968s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.network.neutron [req-3e6faa2b-fe68-4324-998d-c83e91603392 req-7f54c65d-5685-4ade-88a0-d90ae0e3d381 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Updated VIF entry in instance network info cache for port ab8bcb60-9a8d-45e3-98cf-16703689f2e1. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.network.neutron [req-3e6faa2b-fe68-4324-998d-c83e91603392 req-7f54c65d-5685-4ade-88a0-d90ae0e3d381 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Updating instance_info_cache with network_info: [{"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "address": "fa:16:3e:df:13:71", "network": {"id": "75cf6071-7351-481a-8cf4-bf1c01ecc586", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1467023115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8bcb60-9a", "ovs_interfaceid": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3e6faa2b-fe68-4324-998d-c83e91603392 req-7f54c65d-5685-4ade-88a0-d90ae0e3d381 service nova] Releasing lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279375.7125587, 50f8683d-8b60-4095-9507-a969c37f85e2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 50f8683d-8b60-4095-9507-a969c37f85e2 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:02:55 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Successfully detached device vdb from instance 50f8683d-8b60-4095-9507-a969c37f85e2 from the live domain config.
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxpbMdTA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:55 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5f8439-3fb1-47e2-971e-50d50bdf2887]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:02:55 user nova-compute[71312]: No targets found.
Jul 25 10:02:55 user nova-compute[71312]: iSNS:
Jul 25 10:02:55 user nova-compute[71312]: No targets found.
Jul 25 10:02:55 user nova-compute[71312]: STATIC:
Jul 25 10:02:55 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec
Jul 25 10:02:55 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:02:55 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:02:55 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548
Jul 25 10:02:55 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:02:55 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:02:55 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496
Jul 25 10:02:55 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:02:55 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:02:55 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343
Jul 25 10:02:55 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:02:55 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:02:55 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9
Jul 25 10:02:55 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:02:55 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:02:55 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:02:55 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:02:55 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:02:55 user nova-compute[71312]: FIRMWARE:
Jul 25 10:02:55 user nova-compute[71312]: No targets found.
Jul 25 10:02:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:02:55 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:02:55 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfb4951-ea71-41e2-8714-1884d65020f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lazy-loading 'flavor' on Instance uuid c918b5d0-e8f8-40cc-9c25-71ea69d08756 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c218f016-8417-4822-ab88-e309bd0f82a6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:55 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:55 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:55 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:55 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:02:55 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 (non-flash)
Jul 25 10:02:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:02:55 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:02:55 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:02:55 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:02:55 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:02:55 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 (non-flash)
Jul 25 10:02:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c0298ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548'): ({'sdg'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Removing single pathed devices sdg {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6880720e-c9fd-490d-abc9-9a08c7fd6ad1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[021312ca-5da9-40c5-a8b6-3100bc6d16cc]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Flushing IO for device /dev/sdg {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[080ebc99-1486-4f21-bc54-1ef47f985751]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe514fc-e5c9-440f-ba69-edf1cbca61d5]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.network.neutron [req-663637f1-639e-499d-8c85-8f7f597329f1 req-9f82f33d-74ff-49ef-9efc-169e2e3c01fb service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Updated VIF entry in instance network info cache for port 1022b294-bd18-485e-a79a-25d9a11b6e42. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG nova.network.neutron [req-663637f1-639e-499d-8c85-8f7f597329f1 req-9f82f33d-74ff-49ef-9efc-169e2e3c01fb service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Updating instance_info_cache with network_info: [{"id": "1022b294-bd18-485e-a79a-25d9a11b6e42", "address": "fa:16:3e:e2:13:bd", "network": {"id": "0cebbe11-b08a-472b-b7d3-db59047dabfd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-202502212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "596d8ef54bf748bf8564c8be39d028ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1022b294-bd", "ovs_interfaceid": "1022b294-bd18-485e-a79a-25d9a11b6e42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8532560b-cf7f-400e-9a57-4f839bbb8bc1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-663637f1-639e-499d-8c85-8f7f597329f1 req-9f82f33d-74ff-49ef-9efc-169e2e3c01fb service nova] Releasing lock "refresh_cache-d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc4b881-2055-4aee-9b06-a1a9ed8ef98a]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548, portal: 172.16.0.220,3260]
Jul 25 10:02:56 user nova-compute[71312]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548, portal: 172.16.0.220,3260] successful.
Jul 25 10:02:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:56 user nova-compute[71312]: INFO nova.compute.manager [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Attaching volume 14a1236e-c65b-4217-ae74-37f686ff8104 to /dev/vdb
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242d90aa-1f27-4dad-bef9-d06262b6c548 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4924a45e-34a1-4a11-9499-bf64ee556fbe]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] <== disconnect_volume: return (364ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG os_brick.utils [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8475e8-b215-4b44-b368-4527f52c8962]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7573e9-7d3e-43ef-a85a-47419366be5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1723373b-34ac-4064-a35d-b0075646ee22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e970db-5e06-4a46-ad27-d016e7c70abd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:02:56 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a831df75-5cac-4c77-a1bc-4d2b17ee4431]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG os_brick.utils [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Updating existing volume attachment record: 211256d9-a985-4694-8a63-82a881d81594 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-7188ec64-db4c-4b9b-ad46-beadc222be26 req-f4c9c115-41eb-42c5-9e6d-051ef6d3bcd4 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Received event network-vif-plugged-f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7188ec64-db4c-4b9b-ad46-beadc222be26 req-f4c9c115-41eb-42c5-9e6d-051ef6d3bcd4 service nova] Acquiring lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7188ec64-db4c-4b9b-ad46-beadc222be26 req-f4c9c115-41eb-42c5-9e6d-051ef6d3bcd4 service nova] Lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7188ec64-db4c-4b9b-ad46-beadc222be26 req-f4c9c115-41eb-42c5-9e6d-051ef6d3bcd4 service nova] Lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-7188ec64-db4c-4b9b-ad46-beadc222be26 req-f4c9c115-41eb-42c5-9e6d-051ef6d3bcd4 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] No waiting events found dispatching network-vif-plugged-f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:56 user nova-compute[71312]: WARNING nova.compute.manager [req-7188ec64-db4c-4b9b-ad46-beadc222be26 req-f4c9c115-41eb-42c5-9e6d-051ef6d3bcd4 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Received unexpected event network-vif-plugged-f8b6315a-f86a-4616-97e3-647c1d6fdca7 for instance with vm_state building and task_state spawning.
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279376.3341477, 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:02:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] VM Resumed (Lifecycle Event)
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:02:56 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Instance spawned successfully.
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:02:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279376.3356214, 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:02:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] VM Started (Lifecycle Event)
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:02:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:02:56 user nova-compute[71312]: INFO nova.compute.manager [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Took 6.53 seconds to spawn the instance on the hypervisor.
Jul 25 10:02:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:02:56 user nova-compute[71312]: INFO nova.compute.manager [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Took 7.34 seconds to build instance.
Jul 25 10:02:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-208df891-f261-4b62-9e0b-cc4882a0427a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.441s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:57 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lazy-loading 'flavor' on Instance uuid 50f8683d-8b60-4095-9507-a969c37f85e2 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e896bc19-4217-42a4-9e73-c153205c3831 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "50f8683d-8b60-4095-9507-a969c37f85e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.035s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-784dabd9-e27d-4af3-8a38-41122fa55fde req-6d4a4d86-8da2-4791-a79a-465b91bdfcfa service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received event network-vif-plugged-ab8bcb60-9a8d-45e3-98cf-16703689f2e1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-784dabd9-e27d-4af3-8a38-41122fa55fde req-6d4a4d86-8da2-4791-a79a-465b91bdfcfa service nova] Acquiring lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-784dabd9-e27d-4af3-8a38-41122fa55fde req-6d4a4d86-8da2-4791-a79a-465b91bdfcfa service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-784dabd9-e27d-4af3-8a38-41122fa55fde req-6d4a4d86-8da2-4791-a79a-465b91bdfcfa service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-784dabd9-e27d-4af3-8a38-41122fa55fde req-6d4a4d86-8da2-4791-a79a-465b91bdfcfa service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] No waiting events found dispatching network-vif-plugged-ab8bcb60-9a8d-45e3-98cf-16703689f2e1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:57 user nova-compute[71312]: WARNING nova.compute.manager [req-784dabd9-e27d-4af3-8a38-41122fa55fde req-6d4a4d86-8da2-4791-a79a-465b91bdfcfa service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received unexpected event network-vif-plugged-ab8bcb60-9a8d-45e3-98cf-16703689f2e1 for instance with vm_state active and task_state None.
Jul 25 10:02:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-784dabd9-e27d-4af3-8a38-41122fa55fde req-6d4a4d86-8da2-4791-a79a-465b91bdfcfa service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received event network-vif-plugged-ab8bcb60-9a8d-45e3-98cf-16703689f2e1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:02:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-784dabd9-e27d-4af3-8a38-41122fa55fde req-6d4a4d86-8da2-4791-a79a-465b91bdfcfa service nova] Acquiring lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-784dabd9-e27d-4af3-8a38-41122fa55fde req-6d4a4d86-8da2-4791-a79a-465b91bdfcfa service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-784dabd9-e27d-4af3-8a38-41122fa55fde req-6d4a4d86-8da2-4791-a79a-465b91bdfcfa service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-784dabd9-e27d-4af3-8a38-41122fa55fde req-6d4a4d86-8da2-4791-a79a-465b91bdfcfa service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] No waiting events found dispatching network-vif-plugged-ab8bcb60-9a8d-45e3-98cf-16703689f2e1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:02:57 user nova-compute[71312]: WARNING nova.compute.manager [req-784dabd9-e27d-4af3-8a38-41122fa55fde req-6d4a4d86-8da2-4791-a79a-465b91bdfcfa service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received unexpected event network-vif-plugged-ab8bcb60-9a8d-45e3-98cf-16703689f2e1 for instance with vm_state active and task_state None.
Jul 25 10:02:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG nova.objects.instance [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lazy-loading 'flavor' on Instance uuid d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:02:59 user nova-compute[71312]: INFO nova.compute.manager [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Attaching volume 1436450a-b98c-4ed2-aadb-287eb63d8e52 to /dev/sdc
Jul 25 10:02:59 user nova-compute[71312]: DEBUG os_brick.utils [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c6a96a-b691-4474-abbd-e82e70aeb5d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[831c405d-4aeb-4486-bb27-f63a269d74a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c3cbe1-5e1c-4b3c-82a1-976a9b1d4caa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea4048-8135-4b52-aa40-71f9448d3b70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:02:59 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:02:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9c48e2-bc9e-4db2-9165-0cd0338a3098]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG os_brick.utils [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Updating existing volume attachment record: 01be32ca-8812-46af-9f34-6a35664b1325 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:02:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTuVtdbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:03:03 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:03:03 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:03:03 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d5ddbd-1971-432a-a732-3e61090bb71e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:03:03 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa07893-dc54-466f-9f16-304e79950b7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104] added
Jul 25 10:03:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d3dcbd-560f-4f69-a118-c79be6c62032]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ad341f-dbd8-4dda-95d7-6be9d2b9476b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WTuVtdbn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WTuVtdbn" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37c11d1-6226-40b8-994c-ae6f0d4f9f0e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WTuVtdbn'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[805c06e5-88f8-4f86-bb70-9596b3868c29]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eca6d8-401f-4db3-9747-67ebc0833445]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7485ab7d-7c31-4de2-8a89-eb783fc85be2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104, portal: 172.16.0.220,3260]
Jul 25 10:03:04 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104, portal: 172.16.0.220,3260] successful.
Jul 25 10:03:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1fbbe3-0d19-4b72-bf78-1ce7d64203c3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab100fd1-1636-4f9b-8f8d-ea0bc993821e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 (non-flash)
Jul 25 10:03:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3966af-53d6-45be-81a9-2c2f5963e54c]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:03:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:05 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:03:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTuVtdbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:03:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:03:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26239303866346661', 'path': '/dev/sdg'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:03:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239303866346661', 'path': '/dev/sdg'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:03:05 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lazy-loading 'flavor' on Instance uuid c918b5d0-e8f8-40cc-9c25-71ea69d08756 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:03:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:03:05 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:03:05 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:03:05 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:03:05 user nova-compute[71312]:   <serial>14a1236e-c65b-4217-ae74-37f686ff8104</serial>
Jul 25 10:03:05 user nova-compute[71312]: </disk>
Jul 25 10:03:05 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:03:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:03:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] No BDM found with device name hda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:03:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] No VIF found with MAC fa:16:3e:4a:96:ef, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:03:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0152f3be-aa95-4fe0-a8b1-7fb5d70d4ea4 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.809s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:07 user nova-compute[71312]: INFO nova.compute.manager [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Detaching volume 14a1236e-c65b-4217-ae74-37f686ff8104
Jul 25 10:03:07 user nova-compute[71312]: INFO nova.virt.block_device [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Attempting to driver detach volume 14a1236e-c65b-4217-ae74-37f686ff8104 from mountpoint /dev/vdb
Jul 25 10:03:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Attempting to detach device vdb from instance c918b5d0-e8f8-40cc-9c25-71ea69d08756 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:03:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:03:07 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:03:07 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:03:07 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:03:07 user nova-compute[71312]:   <serial>14a1236e-c65b-4217-ae74-37f686ff8104</serial>
Jul 25 10:03:07 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 10:03:07 user nova-compute[71312]: </disk>
Jul 25 10:03:07 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:03:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Successfully detached device vdb from instance c918b5d0-e8f8-40cc-9c25-71ea69d08756 from the persistent domain config.
Jul 25 10:03:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c918b5d0-e8f8-40cc-9c25-71ea69d08756 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:03:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:03:07 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:03:07 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:03:07 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:03:07 user nova-compute[71312]:   <serial>14a1236e-c65b-4217-ae74-37f686ff8104</serial>
Jul 25 10:03:07 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 10:03:07 user nova-compute[71312]: </disk>
Jul 25 10:03:07 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279388.1782737, c918b5d0-e8f8-40cc-9c25-71ea69d08756 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c918b5d0-e8f8-40cc-9c25-71ea69d08756 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:03:08 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Successfully detached device vdb from instance c918b5d0-e8f8-40cc-9c25-71ea69d08756 from the live domain config.
Jul 25 10:03:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTuVtdbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:03:08 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e52a91-6f67-456b-94d5-a96135768ed4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:03:08 user nova-compute[71312]: No targets found.
Jul 25 10:03:08 user nova-compute[71312]: iSNS:
Jul 25 10:03:08 user nova-compute[71312]: No targets found.
Jul 25 10:03:08 user nova-compute[71312]: STATIC:
Jul 25 10:03:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec
Jul 25 10:03:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:08 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496
Jul 25 10:03:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:08 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343
Jul 25 10:03:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:08 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9
Jul 25 10:03:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:08 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:03:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:08 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104
Jul 25 10:03:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:08 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:08 user nova-compute[71312]: FIRMWARE:
Jul 25 10:03:08 user nova-compute[71312]: No targets found.
Jul 25 10:03:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:03:08 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:03:08 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb30794-e3c3-4a9e-8201-4f2ad628b277]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c35f6f-2c06-442b-8b9c-2fd3b767ecd2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:03:08 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:08 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:08 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:08 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:08 user nova-compute[71312]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 (non-flash)
Jul 25 10:03:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:03:08 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:08 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:08 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:08 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:08 user nova-compute[71312]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 (non-flash)
Jul 25 10:03:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c0258280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104'): ({'sdg'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Removing single pathed devices sdg {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c182e7-044c-4cbc-a2ae-cae3a23a535f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70569f4-ea56-44ed-ae24-0c8127830ad3]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Flushing IO for device /dev/sdg {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb8f7b4-144b-4079-a25c-57c410ec1bb0]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f79dd8-49f3-456b-b542-3ebf4d00bac4]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e921a21d-ef07-45f3-98e6-d26fa9839cd4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e33521e-d4da-4a16-b26f-923d828fa490]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104, portal: 172.16.0.220,3260]
Jul 25 10:03:08 user nova-compute[71312]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104, portal: 172.16.0.220,3260] successful.
Jul 25 10:03:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a1236e-c65b-4217-ae74-37f686ff8104 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[628ff337-1212-4eb6-a060-43da928e3bb0]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] <== disconnect_volume: return (310ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:03:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:03:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:09 user nova-compute[71312]: DEBUG nova.objects.instance [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lazy-loading 'flavor' on Instance uuid c918b5d0-e8f8-40cc-9c25-71ea69d08756 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:03:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-198e8fa0-08d3-459c-be9a-65ef1dc903e6 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "interface-c918b5d0-e8f8-40cc-9c25-71ea69d08756-ab8bcb60-9a8d-45e3-98cf-16703689f2e1" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "interface-c918b5d0-e8f8-40cc-9c25-71ea69d08756-ab8bcb60-9a8d-45e3-98cf-16703689f2e1" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lazy-loading 'flavor' on Instance uuid c918b5d0-e8f8-40cc-9c25-71ea69d08756 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-282503515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-282503515',id=9,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfqLhAiM/fPqXox/lYYvHbsORMvG7EmhROMdWtJDW0gFjkybugS0JoPzqPg5A//Q1NyXk2q9pHeiid5wc4meqjPqIfzYlQ74CfLabiQCTkCNSfq5sY3vsH1zVkcnvVCvw==',key_name='tempest-keypair-791003982',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:01:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b5086ef6cce4cdfafc4a061ab06f894',ramdisk_id='',reservation_id='r-g6z0fs1a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1298550074',owner_user_name='tempest-TaggedAttachmentsTest-1298550074-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6325c3b752a4cd88b584d9acd06d537',uuid=c918b5d0-e8f8-40cc-9c25-71ea69d08756,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "address": "fa:16:3e:df:13:71", "network": {"id": "75cf6071-7351-481a-8cf4-bf1c01ecc586", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1467023115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8bcb60-9a", "ovs_interfaceid": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Converting VIF {"id": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "address": "fa:16:3e:df:13:71", "network": {"id": "75cf6071-7351-481a-8cf4-bf1c01ecc586", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1467023115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8bcb60-9a", "ovs_interfaceid": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:13:71,bridge_name='br-int',has_traffic_filtering=True,id=ab8bcb60-9a8d-45e3-98cf-16703689f2e1,network=Network(75cf6071-7351-481a-8cf4-bf1c01ecc586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8bcb60-9a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:df:13:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapab8bcb60-9a"/></interface> {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:df:13:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapab8bcb60-9a"/></interface> {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Attempting to detach device tapab8bcb60-9a from instance c918b5d0-e8f8-40cc-9c25-71ea69d08756 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] detach device xml: <interface type="ethernet">
Jul 25 10:03:10 user nova-compute[71312]:   <mac address="fa:16:3e:df:13:71"/>
Jul 25 10:03:10 user nova-compute[71312]:   <model type="virtio"/>
Jul 25 10:03:10 user nova-compute[71312]:   <mtu size="1442"/>
Jul 25 10:03:10 user nova-compute[71312]:   <target dev="tapab8bcb60-9a"/>
Jul 25 10:03:10 user nova-compute[71312]: </interface>
Jul 25 10:03:10 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:df:13:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapab8bcb60-9a"/></interface> {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:df:13:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapab8bcb60-9a"/></interface>not found in domain: <domain type='kvm' id='9'>
Jul 25 10:03:10 user nova-compute[71312]:   <name>instance-00000009</name>
Jul 25 10:03:10 user nova-compute[71312]:   <uuid>c918b5d0-e8f8-40cc-9c25-71ea69d08756</uuid>
Jul 25 10:03:10 user nova-compute[71312]:   <metadata>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:03:10 user nova-compute[71312]:   <nova:package version="0.0.0"/>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:name>tempest-device-tagging-server-282503515</nova:name>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:creationTime>2023-07-25 10:02:55</nova:creationTime>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:flavor name="m1.tiny">
Jul 25 10:03:10 user nova-compute[71312]:     <nova:memory>512</nova:memory>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:disk>1</nova:disk>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:swap>0</nova:swap>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:vcpus>1</nova:vcpus>
Jul 25 10:03:10 user nova-compute[71312]:   </nova:flavor>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:owner>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:user uuid="d6325c3b752a4cd88b584d9acd06d537">tempest-TaggedAttachmentsTest-1298550074-project-member</nova:user>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:project uuid="5b5086ef6cce4cdfafc4a061ab06f894">tempest-TaggedAttachmentsTest-1298550074</nova:project>
Jul 25 10:03:10 user nova-compute[71312]:   </nova:owner>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:ports>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:port uuid="682fce50-406a-4315-b5fc-b434a6c7c890">
Jul 25 10:03:10 user nova-compute[71312]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:03:10 user nova-compute[71312]:     </nova:port>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:port uuid="ab8bcb60-9a8d-45e3-98cf-16703689f2e1">
Jul 25 10:03:10 user nova-compute[71312]:       <nova:ip type="fixed" address="10.10.10.243" ipVersion="4"/>
Jul 25 10:03:10 user nova-compute[71312]:     </nova:port>
Jul 25 10:03:10 user nova-compute[71312]:   </nova:ports>
Jul 25 10:03:10 user nova-compute[71312]: </nova:instance>
Jul 25 10:03:10 user nova-compute[71312]:   </metadata>
Jul 25 10:03:10 user nova-compute[71312]:   <memory unit='KiB'>524288</memory>
Jul 25 10:03:10 user nova-compute[71312]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 25 10:03:10 user nova-compute[71312]:   <vcpu placement='static'>1</vcpu>
Jul 25 10:03:10 user nova-compute[71312]:   <resource>
Jul 25 10:03:10 user nova-compute[71312]:     <partition>/machine</partition>
Jul 25 10:03:10 user nova-compute[71312]:   </resource>
Jul 25 10:03:10 user nova-compute[71312]:   <sysinfo type='smbios'>
Jul 25 10:03:10 user nova-compute[71312]:     <system>
Jul 25 10:03:10 user nova-compute[71312]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 25 10:03:10 user nova-compute[71312]:       <entry name='product'>OpenStack Nova</entry>
Jul 25 10:03:10 user nova-compute[71312]:       <entry name='version'>0.0.0</entry>
Jul 25 10:03:10 user nova-compute[71312]:       <entry name='serial'>c918b5d0-e8f8-40cc-9c25-71ea69d08756</entry>
Jul 25 10:03:10 user nova-compute[71312]:       <entry name='uuid'>c918b5d0-e8f8-40cc-9c25-71ea69d08756</entry>
Jul 25 10:03:10 user nova-compute[71312]:       <entry name='family'>Virtual Machine</entry>
Jul 25 10:03:10 user nova-compute[71312]:     </system>
Jul 25 10:03:10 user nova-compute[71312]:   </sysinfo>
Jul 25 10:03:10 user nova-compute[71312]:   <os>
Jul 25 10:03:10 user nova-compute[71312]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 25 10:03:10 user nova-compute[71312]:     <boot dev='hd'/>
Jul 25 10:03:10 user nova-compute[71312]:     <smbios mode='sysinfo'/>
Jul 25 10:03:10 user nova-compute[71312]:   </os>
Jul 25 10:03:10 user nova-compute[71312]:   <features>
Jul 25 10:03:10 user nova-compute[71312]:     <acpi/>
Jul 25 10:03:10 user nova-compute[71312]:     <apic/>
Jul 25 10:03:10 user nova-compute[71312]:     <vmcoreinfo state='on'/>
Jul 25 10:03:10 user nova-compute[71312]:   </features>
Jul 25 10:03:10 user nova-compute[71312]:   <cpu mode='custom' match='exact' check='full'>
Jul 25 10:03:10 user nova-compute[71312]:     <model fallback='forbid'>Nehalem</model>
Jul 25 10:03:10 user nova-compute[71312]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 25 10:03:10 user nova-compute[71312]:     <feature policy='require' name='vme'/>
Jul 25 10:03:10 user nova-compute[71312]:     <feature policy='require' name='x2apic'/>
Jul 25 10:03:10 user nova-compute[71312]:     <feature policy='require' name='hypervisor'/>
Jul 25 10:03:10 user nova-compute[71312]:   </cpu>
Jul 25 10:03:10 user nova-compute[71312]:   <clock offset='utc'>
Jul 25 10:03:10 user nova-compute[71312]:     <timer name='pit' tickpolicy='delay'/>
Jul 25 10:03:10 user nova-compute[71312]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 25 10:03:10 user nova-compute[71312]:     <timer name='hpet' present='no'/>
Jul 25 10:03:10 user nova-compute[71312]:   </clock>
Jul 25 10:03:10 user nova-compute[71312]:   <on_poweroff>destroy</on_poweroff>
Jul 25 10:03:10 user nova-compute[71312]:   <on_reboot>restart</on_reboot>
Jul 25 10:03:10 user nova-compute[71312]:   <on_crash>destroy</on_crash>
Jul 25 10:03:10 user nova-compute[71312]:   <devices>
Jul 25 10:03:10 user nova-compute[71312]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 10:03:10 user nova-compute[71312]:     <disk type='file' device='disk'>
Jul 25 10:03:10 user nova-compute[71312]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 25 10:03:10 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk' index='2'/>
Jul 25 10:03:10 user nova-compute[71312]:       <backingStore type='file' index='3'>
Jul 25 10:03:10 user nova-compute[71312]:         <format type='raw'/>
Jul 25 10:03:10 user nova-compute[71312]:         <source file='/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62'/>
Jul 25 10:03:10 user nova-compute[71312]:         <backingStore/>
Jul 25 10:03:10 user nova-compute[71312]:       </backingStore>
Jul 25 10:03:10 user nova-compute[71312]:       <target dev='vda' bus='virtio'/>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='virtio-disk0'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </disk>
Jul 25 10:03:10 user nova-compute[71312]:     <disk type='file' device='cdrom'>
Jul 25 10:03:10 user nova-compute[71312]:       <driver name='qemu' type='raw' cache='none'/>
Jul 25 10:03:10 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk.config' index='1'/>
Jul 25 10:03:10 user nova-compute[71312]:       <backingStore/>
Jul 25 10:03:10 user nova-compute[71312]:       <target dev='hda' bus='ide'/>
Jul 25 10:03:10 user nova-compute[71312]:       <readonly/>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='ide0-0-0'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </disk>
Jul 25 10:03:10 user nova-compute[71312]:     <controller type='usb' index='0' model='none'>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='usb'/>
Jul 25 10:03:10 user nova-compute[71312]:     </controller>
Jul 25 10:03:10 user nova-compute[71312]:     <controller type='pci' index='0' model='pci-root'>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='pci.0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </controller>
Jul 25 10:03:10 user nova-compute[71312]:     <controller type='ide' index='0'>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='ide'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 25 10:03:10 user nova-compute[71312]:     </controller>
Jul 25 10:03:10 user nova-compute[71312]:     <interface type='ethernet'>
Jul 25 10:03:10 user nova-compute[71312]:       <mac address='fa:16:3e:4a:96:ef'/>
Jul 25 10:03:10 user nova-compute[71312]:       <target dev='tap682fce50-40'/>
Jul 25 10:03:10 user nova-compute[71312]:       <model type='virtio'/>
Jul 25 10:03:10 user nova-compute[71312]:       <mtu size='1442'/>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='net0'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </interface>
Jul 25 10:03:10 user nova-compute[71312]:     <interface type='ethernet'>
Jul 25 10:03:10 user nova-compute[71312]:       <mac address='fa:16:3e:df:13:71'/>
Jul 25 10:03:10 user nova-compute[71312]:       <target dev='tapab8bcb60-9a'/>
Jul 25 10:03:10 user nova-compute[71312]:       <model type='virtio'/>
Jul 25 10:03:10 user nova-compute[71312]:       <mtu size='1442'/>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='net1'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </interface>
Jul 25 10:03:10 user nova-compute[71312]:     <serial type='pty'>
Jul 25 10:03:10 user nova-compute[71312]:       <source path='/dev/pts/8'/>
Jul 25 10:03:10 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/console.log' append='off'/>
Jul 25 10:03:10 user nova-compute[71312]:       <target type='isa-serial' port='0'>
Jul 25 10:03:10 user nova-compute[71312]:         <model name='isa-serial'/>
Jul 25 10:03:10 user nova-compute[71312]:       </target>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='serial0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </serial>
Jul 25 10:03:10 user nova-compute[71312]:     <console type='pty' tty='/dev/pts/8'>
Jul 25 10:03:10 user nova-compute[71312]:       <source path='/dev/pts/8'/>
Jul 25 10:03:10 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/console.log' append='off'/>
Jul 25 10:03:10 user nova-compute[71312]:       <target type='serial' port='0'/>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='serial0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </console>
Jul 25 10:03:10 user nova-compute[71312]:     <input type='mouse' bus='ps2'>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='input0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </input>
Jul 25 10:03:10 user nova-compute[71312]:     <input type='keyboard' bus='ps2'>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='input1'/>
Jul 25 10:03:10 user nova-compute[71312]:     </input>
Jul 25 10:03:10 user nova-compute[71312]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 25 10:03:10 user nova-compute[71312]:       <listen type='address' address='0.0.0.0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </graphics>
Jul 25 10:03:10 user nova-compute[71312]:     <audio id='1' type='none'/>
Jul 25 10:03:10 user nova-compute[71312]:     <video>
Jul 25 10:03:10 user nova-compute[71312]:       <model type='virtio' heads='1' primary='yes'/>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='video0'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </video>
Jul 25 10:03:10 user nova-compute[71312]:     <memballoon model='virtio'>
Jul 25 10:03:10 user nova-compute[71312]:       <stats period='10'/>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='balloon0'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </memballoon>
Jul 25 10:03:10 user nova-compute[71312]:     <rng model='virtio'>
Jul 25 10:03:10 user nova-compute[71312]:       <backend model='random'>/dev/urandom</backend>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='rng0'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </rng>
Jul 25 10:03:10 user nova-compute[71312]:   </devices>
Jul 25 10:03:10 user nova-compute[71312]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 25 10:03:10 user nova-compute[71312]:     <label>libvirt-c918b5d0-e8f8-40cc-9c25-71ea69d08756</label>
Jul 25 10:03:10 user nova-compute[71312]:     <imagelabel>libvirt-c918b5d0-e8f8-40cc-9c25-71ea69d08756</imagelabel>
Jul 25 10:03:10 user nova-compute[71312]:   </seclabel>
Jul 25 10:03:10 user nova-compute[71312]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 25 10:03:10 user nova-compute[71312]:     <label>+64055:+108</label>
Jul 25 10:03:10 user nova-compute[71312]:     <imagelabel>+64055:+108</imagelabel>
Jul 25 10:03:10 user nova-compute[71312]:   </seclabel>
Jul 25 10:03:10 user nova-compute[71312]: </domain>
Jul 25 10:03:10 user nova-compute[71312]:  {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 25 10:03:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Successfully detached device tapab8bcb60-9a from instance c918b5d0-e8f8-40cc-9c25-71ea69d08756 from the persistent domain config.
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] (1/8): Attempting to detach device tapab8bcb60-9a with device alias net1 from instance c918b5d0-e8f8-40cc-9c25-71ea69d08756 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] detach device xml: <interface type="ethernet">
Jul 25 10:03:10 user nova-compute[71312]:   <mac address="fa:16:3e:df:13:71"/>
Jul 25 10:03:10 user nova-compute[71312]:   <model type="virtio"/>
Jul 25 10:03:10 user nova-compute[71312]:   <mtu size="1442"/>
Jul 25 10:03:10 user nova-compute[71312]:   <target dev="tapab8bcb60-9a"/>
Jul 25 10:03:10 user nova-compute[71312]: </interface>
Jul 25 10:03:10 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279390.4850156, c918b5d0-e8f8-40cc-9c25-71ea69d08756 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Start waiting for the detach event from libvirt for device tapab8bcb60-9a with device alias net1 for instance c918b5d0-e8f8-40cc-9c25-71ea69d08756 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:df:13:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapab8bcb60-9a"/></interface> {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:df:13:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapab8bcb60-9a"/></interface>not found in domain: <domain type='kvm' id='9'>
Jul 25 10:03:10 user nova-compute[71312]:   <name>instance-00000009</name>
Jul 25 10:03:10 user nova-compute[71312]:   <uuid>c918b5d0-e8f8-40cc-9c25-71ea69d08756</uuid>
Jul 25 10:03:10 user nova-compute[71312]:   <metadata>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:03:10 user nova-compute[71312]:   <nova:package version="0.0.0"/>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:name>tempest-device-tagging-server-282503515</nova:name>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:creationTime>2023-07-25 10:02:55</nova:creationTime>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:flavor name="m1.tiny">
Jul 25 10:03:10 user nova-compute[71312]:     <nova:memory>512</nova:memory>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:disk>1</nova:disk>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:swap>0</nova:swap>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:vcpus>1</nova:vcpus>
Jul 25 10:03:10 user nova-compute[71312]:   </nova:flavor>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:owner>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:user uuid="d6325c3b752a4cd88b584d9acd06d537">tempest-TaggedAttachmentsTest-1298550074-project-member</nova:user>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:project uuid="5b5086ef6cce4cdfafc4a061ab06f894">tempest-TaggedAttachmentsTest-1298550074</nova:project>
Jul 25 10:03:10 user nova-compute[71312]:   </nova:owner>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:ports>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:port uuid="682fce50-406a-4315-b5fc-b434a6c7c890">
Jul 25 10:03:10 user nova-compute[71312]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:03:10 user nova-compute[71312]:     </nova:port>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:port uuid="ab8bcb60-9a8d-45e3-98cf-16703689f2e1">
Jul 25 10:03:10 user nova-compute[71312]:       <nova:ip type="fixed" address="10.10.10.243" ipVersion="4"/>
Jul 25 10:03:10 user nova-compute[71312]:     </nova:port>
Jul 25 10:03:10 user nova-compute[71312]:   </nova:ports>
Jul 25 10:03:10 user nova-compute[71312]: </nova:instance>
Jul 25 10:03:10 user nova-compute[71312]:   </metadata>
Jul 25 10:03:10 user nova-compute[71312]:   <memory unit='KiB'>524288</memory>
Jul 25 10:03:10 user nova-compute[71312]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 25 10:03:10 user nova-compute[71312]:   <vcpu placement='static'>1</vcpu>
Jul 25 10:03:10 user nova-compute[71312]:   <resource>
Jul 25 10:03:10 user nova-compute[71312]:     <partition>/machine</partition>
Jul 25 10:03:10 user nova-compute[71312]:   </resource>
Jul 25 10:03:10 user nova-compute[71312]:   <sysinfo type='smbios'>
Jul 25 10:03:10 user nova-compute[71312]:     <system>
Jul 25 10:03:10 user nova-compute[71312]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 25 10:03:10 user nova-compute[71312]:       <entry name='product'>OpenStack Nova</entry>
Jul 25 10:03:10 user nova-compute[71312]:       <entry name='version'>0.0.0</entry>
Jul 25 10:03:10 user nova-compute[71312]:       <entry name='serial'>c918b5d0-e8f8-40cc-9c25-71ea69d08756</entry>
Jul 25 10:03:10 user nova-compute[71312]:       <entry name='uuid'>c918b5d0-e8f8-40cc-9c25-71ea69d08756</entry>
Jul 25 10:03:10 user nova-compute[71312]:       <entry name='family'>Virtual Machine</entry>
Jul 25 10:03:10 user nova-compute[71312]:     </system>
Jul 25 10:03:10 user nova-compute[71312]:   </sysinfo>
Jul 25 10:03:10 user nova-compute[71312]:   <os>
Jul 25 10:03:10 user nova-compute[71312]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 25 10:03:10 user nova-compute[71312]:     <boot dev='hd'/>
Jul 25 10:03:10 user nova-compute[71312]:     <smbios mode='sysinfo'/>
Jul 25 10:03:10 user nova-compute[71312]:   </os>
Jul 25 10:03:10 user nova-compute[71312]:   <features>
Jul 25 10:03:10 user nova-compute[71312]:     <acpi/>
Jul 25 10:03:10 user nova-compute[71312]:     <apic/>
Jul 25 10:03:10 user nova-compute[71312]:     <vmcoreinfo state='on'/>
Jul 25 10:03:10 user nova-compute[71312]:   </features>
Jul 25 10:03:10 user nova-compute[71312]:   <cpu mode='custom' match='exact' check='full'>
Jul 25 10:03:10 user nova-compute[71312]:     <model fallback='forbid'>Nehalem</model>
Jul 25 10:03:10 user nova-compute[71312]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 25 10:03:10 user nova-compute[71312]:     <feature policy='require' name='vme'/>
Jul 25 10:03:10 user nova-compute[71312]:     <feature policy='require' name='x2apic'/>
Jul 25 10:03:10 user nova-compute[71312]:     <feature policy='require' name='hypervisor'/>
Jul 25 10:03:10 user nova-compute[71312]:   </cpu>
Jul 25 10:03:10 user nova-compute[71312]:   <clock offset='utc'>
Jul 25 10:03:10 user nova-compute[71312]:     <timer name='pit' tickpolicy='delay'/>
Jul 25 10:03:10 user nova-compute[71312]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 25 10:03:10 user nova-compute[71312]:     <timer name='hpet' present='no'/>
Jul 25 10:03:10 user nova-compute[71312]:   </clock>
Jul 25 10:03:10 user nova-compute[71312]:   <on_poweroff>destroy</on_poweroff>
Jul 25 10:03:10 user nova-compute[71312]:   <on_reboot>restart</on_reboot>
Jul 25 10:03:10 user nova-compute[71312]:   <on_crash>destroy</on_crash>
Jul 25 10:03:10 user nova-compute[71312]:   <devices>
Jul 25 10:03:10 user nova-compute[71312]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 10:03:10 user nova-compute[71312]:     <disk type='file' device='disk'>
Jul 25 10:03:10 user nova-compute[71312]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 25 10:03:10 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk' index='2'/>
Jul 25 10:03:10 user nova-compute[71312]:       <backingStore type='file' index='3'>
Jul 25 10:03:10 user nova-compute[71312]:         <format type='raw'/>
Jul 25 10:03:10 user nova-compute[71312]:         <source file='/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62'/>
Jul 25 10:03:10 user nova-compute[71312]:         <backingStore/>
Jul 25 10:03:10 user nova-compute[71312]:       </backingStore>
Jul 25 10:03:10 user nova-compute[71312]:       <target dev='vda' bus='virtio'/>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='virtio-disk0'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </disk>
Jul 25 10:03:10 user nova-compute[71312]:     <disk type='file' device='cdrom'>
Jul 25 10:03:10 user nova-compute[71312]:       <driver name='qemu' type='raw' cache='none'/>
Jul 25 10:03:10 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk.config' index='1'/>
Jul 25 10:03:10 user nova-compute[71312]:       <backingStore/>
Jul 25 10:03:10 user nova-compute[71312]:       <target dev='hda' bus='ide'/>
Jul 25 10:03:10 user nova-compute[71312]:       <readonly/>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='ide0-0-0'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </disk>
Jul 25 10:03:10 user nova-compute[71312]:     <controller type='usb' index='0' model='none'>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='usb'/>
Jul 25 10:03:10 user nova-compute[71312]:     </controller>
Jul 25 10:03:10 user nova-compute[71312]:     <controller type='pci' index='0' model='pci-root'>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='pci.0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </controller>
Jul 25 10:03:10 user nova-compute[71312]:     <controller type='ide' index='0'>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='ide'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 25 10:03:10 user nova-compute[71312]:     </controller>
Jul 25 10:03:10 user nova-compute[71312]:     <interface type='ethernet'>
Jul 25 10:03:10 user nova-compute[71312]:       <mac address='fa:16:3e:4a:96:ef'/>
Jul 25 10:03:10 user nova-compute[71312]:       <target dev='tap682fce50-40'/>
Jul 25 10:03:10 user nova-compute[71312]:       <model type='virtio'/>
Jul 25 10:03:10 user nova-compute[71312]:       <mtu size='1442'/>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='net0'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </interface>
Jul 25 10:03:10 user nova-compute[71312]:     <serial type='pty'>
Jul 25 10:03:10 user nova-compute[71312]:       <source path='/dev/pts/8'/>
Jul 25 10:03:10 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/console.log' append='off'/>
Jul 25 10:03:10 user nova-compute[71312]:       <target type='isa-serial' port='0'>
Jul 25 10:03:10 user nova-compute[71312]:         <model name='isa-serial'/>
Jul 25 10:03:10 user nova-compute[71312]:       </target>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='serial0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </serial>
Jul 25 10:03:10 user nova-compute[71312]:     <console type='pty' tty='/dev/pts/8'>
Jul 25 10:03:10 user nova-compute[71312]:       <source path='/dev/pts/8'/>
Jul 25 10:03:10 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/console.log' append='off'/>
Jul 25 10:03:10 user nova-compute[71312]:       <target type='serial' port='0'/>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='serial0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </console>
Jul 25 10:03:10 user nova-compute[71312]:     <input type='mouse' bus='ps2'>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='input0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </input>
Jul 25 10:03:10 user nova-compute[71312]:     <input type='keyboard' bus='ps2'>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='input1'/>
Jul 25 10:03:10 user nova-compute[71312]:     </input>
Jul 25 10:03:10 user nova-compute[71312]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 25 10:03:10 user nova-compute[71312]:       <listen type='address' address='0.0.0.0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </graphics>
Jul 25 10:03:10 user nova-compute[71312]:     <audio id='1' type='none'/>
Jul 25 10:03:10 user nova-compute[71312]:     <video>
Jul 25 10:03:10 user nova-compute[71312]:       <model type='virtio' heads='1' primary='yes'/>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='video0'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </video>
Jul 25 10:03:10 user nova-compute[71312]:     <memballoon model='virtio'>
Jul 25 10:03:10 user nova-compute[71312]:       <stats period='10'/>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='balloon0'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </memballoon>
Jul 25 10:03:10 user nova-compute[71312]:     <rng model='virtio'>
Jul 25 10:03:10 user nova-compute[71312]:       <backend model='random'>/dev/urandom</backend>
Jul 25 10:03:10 user nova-compute[71312]:       <alias name='rng0'/>
Jul 25 10:03:10 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 25 10:03:10 user nova-compute[71312]:     </rng>
Jul 25 10:03:10 user nova-compute[71312]:   </devices>
Jul 25 10:03:10 user nova-compute[71312]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 25 10:03:10 user nova-compute[71312]:     <label>libvirt-c918b5d0-e8f8-40cc-9c25-71ea69d08756</label>
Jul 25 10:03:10 user nova-compute[71312]:     <imagelabel>libvirt-c918b5d0-e8f8-40cc-9c25-71ea69d08756</imagelabel>
Jul 25 10:03:10 user nova-compute[71312]:   </seclabel>
Jul 25 10:03:10 user nova-compute[71312]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 25 10:03:10 user nova-compute[71312]:     <label>+64055:+108</label>
Jul 25 10:03:10 user nova-compute[71312]:     <imagelabel>+64055:+108</imagelabel>
Jul 25 10:03:10 user nova-compute[71312]:   </seclabel>
Jul 25 10:03:10 user nova-compute[71312]: </domain>
Jul 25 10:03:10 user nova-compute[71312]:  {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 25 10:03:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Successfully detached device tapab8bcb60-9a from instance c918b5d0-e8f8-40cc-9c25-71ea69d08756 from the live domain config.
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-282503515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-282503515',id=9,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfqLhAiM/fPqXox/lYYvHbsORMvG7EmhROMdWtJDW0gFjkybugS0JoPzqPg5A//Q1NyXk2q9pHeiid5wc4meqjPqIfzYlQ74CfLabiQCTkCNSfq5sY3vsH1zVkcnvVCvw==',key_name='tempest-keypair-791003982',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:01:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b5086ef6cce4cdfafc4a061ab06f894',ramdisk_id='',reservation_id='r-g6z0fs1a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1298550074',owner_user_name='tempest-TaggedAttachmentsTest-1298550074-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6325c3b752a4cd88b584d9acd06d537',uuid=c918b5d0-e8f8-40cc-9c25-71ea69d08756,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "address": "fa:16:3e:df:13:71", "network": {"id": "75cf6071-7351-481a-8cf4-bf1c01ecc586", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1467023115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8bcb60-9a", "ovs_interfaceid": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Converting VIF {"id": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "address": "fa:16:3e:df:13:71", "network": {"id": "75cf6071-7351-481a-8cf4-bf1c01ecc586", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1467023115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8bcb60-9a", "ovs_interfaceid": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:13:71,bridge_name='br-int',has_traffic_filtering=True,id=ab8bcb60-9a8d-45e3-98cf-16703689f2e1,network=Network(75cf6071-7351-481a-8cf4-bf1c01ecc586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8bcb60-9a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG os_vif [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:13:71,bridge_name='br-int',has_traffic_filtering=True,id=ab8bcb60-9a8d-45e3-98cf-16703689f2e1,network=Network(75cf6071-7351-481a-8cf4-bf1c01ecc586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8bcb60-9a') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab8bcb60-9a, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:10 user nova-compute[71312]: INFO os_vif [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:13:71,bridge_name='br-int',has_traffic_filtering=True,id=ab8bcb60-9a8d-45e3-98cf-16703689f2e1,network=Network(75cf6071-7351-481a-8cf4-bf1c01ecc586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8bcb60-9a')
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:03:10 user nova-compute[71312]:   <nova:package version="0.0.0"/>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:name>tempest-device-tagging-server-282503515</nova:name>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:creationTime>2023-07-25 10:03:10</nova:creationTime>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:flavor name="m1.tiny">
Jul 25 10:03:10 user nova-compute[71312]:     <nova:memory>512</nova:memory>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:disk>1</nova:disk>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:swap>0</nova:swap>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:vcpus>1</nova:vcpus>
Jul 25 10:03:10 user nova-compute[71312]:   </nova:flavor>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:owner>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:user uuid="d6325c3b752a4cd88b584d9acd06d537">tempest-TaggedAttachmentsTest-1298550074-project-member</nova:user>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:project uuid="5b5086ef6cce4cdfafc4a061ab06f894">tempest-TaggedAttachmentsTest-1298550074</nova:project>
Jul 25 10:03:10 user nova-compute[71312]:   </nova:owner>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:03:10 user nova-compute[71312]:   <nova:ports>
Jul 25 10:03:10 user nova-compute[71312]:     <nova:port uuid="682fce50-406a-4315-b5fc-b434a6c7c890">
Jul 25 10:03:10 user nova-compute[71312]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:03:10 user nova-compute[71312]:     </nova:port>
Jul 25 10:03:10 user nova-compute[71312]:   </nova:ports>
Jul 25 10:03:10 user nova-compute[71312]: </nova:instance>
Jul 25 10:03:10 user nova-compute[71312]:  {{(pid=71312) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-038b2945-33cc-4883-92d9-4a050dce1920 req-68352d0e-be35-4d9b-bfe0-a1a4488610bb service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received event network-vif-unplugged-ab8bcb60-9a8d-45e3-98cf-16703689f2e1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-038b2945-33cc-4883-92d9-4a050dce1920 req-68352d0e-be35-4d9b-bfe0-a1a4488610bb service nova] Acquiring lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-038b2945-33cc-4883-92d9-4a050dce1920 req-68352d0e-be35-4d9b-bfe0-a1a4488610bb service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-038b2945-33cc-4883-92d9-4a050dce1920 req-68352d0e-be35-4d9b-bfe0-a1a4488610bb service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-038b2945-33cc-4883-92d9-4a050dce1920 req-68352d0e-be35-4d9b-bfe0-a1a4488610bb service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] No waiting events found dispatching network-vif-unplugged-ab8bcb60-9a8d-45e3-98cf-16703689f2e1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:10 user nova-compute[71312]: WARNING nova.compute.manager [req-038b2945-33cc-4883-92d9-4a050dce1920 req-68352d0e-be35-4d9b-bfe0-a1a4488610bb service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received unexpected event network-vif-unplugged-ab8bcb60-9a8d-45e3-98cf-16703689f2e1 for instance with vm_state active and task_state None.
Jul 25 10:03:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received event network-vif-deleted-ab8bcb60-9a8d-45e3-98cf-16703689f2e1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:11 user nova-compute[71312]: INFO nova.compute.manager [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Neutron deleted interface ab8bcb60-9a8d-45e3-98cf-16703689f2e1; detaching it from the instance and deleting it from the info cache
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Updating instance_info_cache with network_info: [{"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquired lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.objects.instance [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] Lazy-loading 'system_metadata' on Instance uuid c918b5d0-e8f8-40cc-9c25-71ea69d08756 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.objects.instance [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] Lazy-loading 'flavor' on Instance uuid c918b5d0-e8f8-40cc-9c25-71ea69d08756 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-282503515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-282503515',id=9,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfqLhAiM/fPqXox/lYYvHbsORMvG7EmhROMdWtJDW0gFjkybugS0JoPzqPg5A//Q1NyXk2q9pHeiid5wc4meqjPqIfzYlQ74CfLabiQCTkCNSfq5sY3vsH1zVkcnvVCvw==',key_name='tempest-keypair-791003982',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:01:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b5086ef6cce4cdfafc4a061ab06f894',ramdisk_id='',reservation_id='r-g6z0fs1a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1298550074',owner_user_name='tempest-TaggedAttachmentsTest-1298550074-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6325c3b752a4cd88b584d9acd06d537',uuid=c918b5d0-e8f8-40cc-9c25-71ea69d08756,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "address": "fa:16:3e:df:13:71", "network": {"id": "75cf6071-7351-481a-8cf4-bf1c01ecc586", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1467023115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8bcb60-9a", "ovs_interfaceid": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] Converting VIF {"id": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "address": "fa:16:3e:df:13:71", "network": {"id": "75cf6071-7351-481a-8cf4-bf1c01ecc586", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1467023115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8bcb60-9a", "ovs_interfaceid": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:13:71,bridge_name='br-int',has_traffic_filtering=True,id=ab8bcb60-9a8d-45e3-98cf-16703689f2e1,network=Network(75cf6071-7351-481a-8cf4-bf1c01ecc586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8bcb60-9a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:df:13:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapab8bcb60-9a"/></interface> {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:df:13:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapab8bcb60-9a"/></interface>not found in domain: <domain type='kvm' id='9'>
Jul 25 10:03:11 user nova-compute[71312]:   <name>instance-00000009</name>
Jul 25 10:03:11 user nova-compute[71312]:   <uuid>c918b5d0-e8f8-40cc-9c25-71ea69d08756</uuid>
Jul 25 10:03:11 user nova-compute[71312]:   <metadata>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:03:11 user nova-compute[71312]:   <nova:package version="0.0.0"/>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:name>tempest-device-tagging-server-282503515</nova:name>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:creationTime>2023-07-25 10:03:10</nova:creationTime>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:flavor name="m1.tiny">
Jul 25 10:03:11 user nova-compute[71312]:     <nova:memory>512</nova:memory>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:disk>1</nova:disk>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:swap>0</nova:swap>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:vcpus>1</nova:vcpus>
Jul 25 10:03:11 user nova-compute[71312]:   </nova:flavor>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:owner>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:user uuid="d6325c3b752a4cd88b584d9acd06d537">tempest-TaggedAttachmentsTest-1298550074-project-member</nova:user>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:project uuid="5b5086ef6cce4cdfafc4a061ab06f894">tempest-TaggedAttachmentsTest-1298550074</nova:project>
Jul 25 10:03:11 user nova-compute[71312]:   </nova:owner>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:ports>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:port uuid="682fce50-406a-4315-b5fc-b434a6c7c890">
Jul 25 10:03:11 user nova-compute[71312]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:03:11 user nova-compute[71312]:     </nova:port>
Jul 25 10:03:11 user nova-compute[71312]:   </nova:ports>
Jul 25 10:03:11 user nova-compute[71312]: </nova:instance>
Jul 25 10:03:11 user nova-compute[71312]:   </metadata>
Jul 25 10:03:11 user nova-compute[71312]:   <memory unit='KiB'>524288</memory>
Jul 25 10:03:11 user nova-compute[71312]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 25 10:03:11 user nova-compute[71312]:   <vcpu placement='static'>1</vcpu>
Jul 25 10:03:11 user nova-compute[71312]:   <resource>
Jul 25 10:03:11 user nova-compute[71312]:     <partition>/machine</partition>
Jul 25 10:03:11 user nova-compute[71312]:   </resource>
Jul 25 10:03:11 user nova-compute[71312]:   <sysinfo type='smbios'>
Jul 25 10:03:11 user nova-compute[71312]:     <system>
Jul 25 10:03:11 user nova-compute[71312]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 25 10:03:11 user nova-compute[71312]:       <entry name='product'>OpenStack Nova</entry>
Jul 25 10:03:11 user nova-compute[71312]:       <entry name='version'>0.0.0</entry>
Jul 25 10:03:11 user nova-compute[71312]:       <entry name='serial'>c918b5d0-e8f8-40cc-9c25-71ea69d08756</entry>
Jul 25 10:03:11 user nova-compute[71312]:       <entry name='uuid'>c918b5d0-e8f8-40cc-9c25-71ea69d08756</entry>
Jul 25 10:03:11 user nova-compute[71312]:       <entry name='family'>Virtual Machine</entry>
Jul 25 10:03:11 user nova-compute[71312]:     </system>
Jul 25 10:03:11 user nova-compute[71312]:   </sysinfo>
Jul 25 10:03:11 user nova-compute[71312]:   <os>
Jul 25 10:03:11 user nova-compute[71312]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 25 10:03:11 user nova-compute[71312]:     <boot dev='hd'/>
Jul 25 10:03:11 user nova-compute[71312]:     <smbios mode='sysinfo'/>
Jul 25 10:03:11 user nova-compute[71312]:   </os>
Jul 25 10:03:11 user nova-compute[71312]:   <features>
Jul 25 10:03:11 user nova-compute[71312]:     <acpi/>
Jul 25 10:03:11 user nova-compute[71312]:     <apic/>
Jul 25 10:03:11 user nova-compute[71312]:     <vmcoreinfo state='on'/>
Jul 25 10:03:11 user nova-compute[71312]:   </features>
Jul 25 10:03:11 user nova-compute[71312]:   <cpu mode='custom' match='exact' check='full'>
Jul 25 10:03:11 user nova-compute[71312]:     <model fallback='forbid'>Nehalem</model>
Jul 25 10:03:11 user nova-compute[71312]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 25 10:03:11 user nova-compute[71312]:     <feature policy='require' name='vme'/>
Jul 25 10:03:11 user nova-compute[71312]:     <feature policy='require' name='x2apic'/>
Jul 25 10:03:11 user nova-compute[71312]:     <feature policy='require' name='hypervisor'/>
Jul 25 10:03:11 user nova-compute[71312]:   </cpu>
Jul 25 10:03:11 user nova-compute[71312]:   <clock offset='utc'>
Jul 25 10:03:11 user nova-compute[71312]:     <timer name='pit' tickpolicy='delay'/>
Jul 25 10:03:11 user nova-compute[71312]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 25 10:03:11 user nova-compute[71312]:     <timer name='hpet' present='no'/>
Jul 25 10:03:11 user nova-compute[71312]:   </clock>
Jul 25 10:03:11 user nova-compute[71312]:   <on_poweroff>destroy</on_poweroff>
Jul 25 10:03:11 user nova-compute[71312]:   <on_reboot>restart</on_reboot>
Jul 25 10:03:11 user nova-compute[71312]:   <on_crash>destroy</on_crash>
Jul 25 10:03:11 user nova-compute[71312]:   <devices>
Jul 25 10:03:11 user nova-compute[71312]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 10:03:11 user nova-compute[71312]:     <disk type='file' device='disk'>
Jul 25 10:03:11 user nova-compute[71312]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 25 10:03:11 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk' index='2'/>
Jul 25 10:03:11 user nova-compute[71312]:       <backingStore type='file' index='3'>
Jul 25 10:03:11 user nova-compute[71312]:         <format type='raw'/>
Jul 25 10:03:11 user nova-compute[71312]:         <source file='/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62'/>
Jul 25 10:03:11 user nova-compute[71312]:         <backingStore/>
Jul 25 10:03:11 user nova-compute[71312]:       </backingStore>
Jul 25 10:03:11 user nova-compute[71312]:       <target dev='vda' bus='virtio'/>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='virtio-disk0'/>
Jul 25 10:03:11 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </disk>
Jul 25 10:03:11 user nova-compute[71312]:     <disk type='file' device='cdrom'>
Jul 25 10:03:11 user nova-compute[71312]:       <driver name='qemu' type='raw' cache='none'/>
Jul 25 10:03:11 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk.config' index='1'/>
Jul 25 10:03:11 user nova-compute[71312]:       <backingStore/>
Jul 25 10:03:11 user nova-compute[71312]:       <target dev='hda' bus='ide'/>
Jul 25 10:03:11 user nova-compute[71312]:       <readonly/>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='ide0-0-0'/>
Jul 25 10:03:11 user nova-compute[71312]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </disk>
Jul 25 10:03:11 user nova-compute[71312]:     <controller type='usb' index='0' model='none'>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='usb'/>
Jul 25 10:03:11 user nova-compute[71312]:     </controller>
Jul 25 10:03:11 user nova-compute[71312]:     <controller type='pci' index='0' model='pci-root'>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='pci.0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </controller>
Jul 25 10:03:11 user nova-compute[71312]:     <controller type='ide' index='0'>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='ide'/>
Jul 25 10:03:11 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 25 10:03:11 user nova-compute[71312]:     </controller>
Jul 25 10:03:11 user nova-compute[71312]:     <interface type='ethernet'>
Jul 25 10:03:11 user nova-compute[71312]:       <mac address='fa:16:3e:4a:96:ef'/>
Jul 25 10:03:11 user nova-compute[71312]:       <target dev='tap682fce50-40'/>
Jul 25 10:03:11 user nova-compute[71312]:       <model type='virtio'/>
Jul 25 10:03:11 user nova-compute[71312]:       <mtu size='1442'/>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='net0'/>
Jul 25 10:03:11 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </interface>
Jul 25 10:03:11 user nova-compute[71312]:     <serial type='pty'>
Jul 25 10:03:11 user nova-compute[71312]:       <source path='/dev/pts/8'/>
Jul 25 10:03:11 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/console.log' append='off'/>
Jul 25 10:03:11 user nova-compute[71312]:       <target type='isa-serial' port='0'>
Jul 25 10:03:11 user nova-compute[71312]:         <model name='isa-serial'/>
Jul 25 10:03:11 user nova-compute[71312]:       </target>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='serial0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </serial>
Jul 25 10:03:11 user nova-compute[71312]:     <console type='pty' tty='/dev/pts/8'>
Jul 25 10:03:11 user nova-compute[71312]:       <source path='/dev/pts/8'/>
Jul 25 10:03:11 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/console.log' append='off'/>
Jul 25 10:03:11 user nova-compute[71312]:       <target type='serial' port='0'/>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='serial0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </console>
Jul 25 10:03:11 user nova-compute[71312]:     <input type='mouse' bus='ps2'>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='input0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </input>
Jul 25 10:03:11 user nova-compute[71312]:     <input type='keyboard' bus='ps2'>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='input1'/>
Jul 25 10:03:11 user nova-compute[71312]:     </input>
Jul 25 10:03:11 user nova-compute[71312]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 25 10:03:11 user nova-compute[71312]:       <listen type='address' address='0.0.0.0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </graphics>
Jul 25 10:03:11 user nova-compute[71312]:     <audio id='1' type='none'/>
Jul 25 10:03:11 user nova-compute[71312]:     <video>
Jul 25 10:03:11 user nova-compute[71312]:       <model type='virtio' heads='1' primary='yes'/>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='video0'/>
Jul 25 10:03:11 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </video>
Jul 25 10:03:11 user nova-compute[71312]:     <memballoon model='virtio'>
Jul 25 10:03:11 user nova-compute[71312]:       <stats period='10'/>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='balloon0'/>
Jul 25 10:03:11 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </memballoon>
Jul 25 10:03:11 user nova-compute[71312]:     <rng model='virtio'>
Jul 25 10:03:11 user nova-compute[71312]:       <backend model='random'>/dev/urandom</backend>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='rng0'/>
Jul 25 10:03:11 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </rng>
Jul 25 10:03:11 user nova-compute[71312]:   </devices>
Jul 25 10:03:11 user nova-compute[71312]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 25 10:03:11 user nova-compute[71312]:     <label>libvirt-c918b5d0-e8f8-40cc-9c25-71ea69d08756</label>
Jul 25 10:03:11 user nova-compute[71312]:     <imagelabel>libvirt-c918b5d0-e8f8-40cc-9c25-71ea69d08756</imagelabel>
Jul 25 10:03:11 user nova-compute[71312]:   </seclabel>
Jul 25 10:03:11 user nova-compute[71312]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 25 10:03:11 user nova-compute[71312]:     <label>+64055:+108</label>
Jul 25 10:03:11 user nova-compute[71312]:     <imagelabel>+64055:+108</imagelabel>
Jul 25 10:03:11 user nova-compute[71312]:   </seclabel>
Jul 25 10:03:11 user nova-compute[71312]: </domain>
Jul 25 10:03:11 user nova-compute[71312]:  {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:df:13:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapab8bcb60-9a"/></interface> {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:df:13:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapab8bcb60-9a"/></interface>not found in domain: <domain type='kvm' id='9'>
Jul 25 10:03:11 user nova-compute[71312]:   <name>instance-00000009</name>
Jul 25 10:03:11 user nova-compute[71312]:   <uuid>c918b5d0-e8f8-40cc-9c25-71ea69d08756</uuid>
Jul 25 10:03:11 user nova-compute[71312]:   <metadata>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:03:11 user nova-compute[71312]:   <nova:package version="0.0.0"/>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:name>tempest-device-tagging-server-282503515</nova:name>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:creationTime>2023-07-25 10:03:10</nova:creationTime>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:flavor name="m1.tiny">
Jul 25 10:03:11 user nova-compute[71312]:     <nova:memory>512</nova:memory>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:disk>1</nova:disk>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:swap>0</nova:swap>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:vcpus>1</nova:vcpus>
Jul 25 10:03:11 user nova-compute[71312]:   </nova:flavor>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:owner>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:user uuid="d6325c3b752a4cd88b584d9acd06d537">tempest-TaggedAttachmentsTest-1298550074-project-member</nova:user>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:project uuid="5b5086ef6cce4cdfafc4a061ab06f894">tempest-TaggedAttachmentsTest-1298550074</nova:project>
Jul 25 10:03:11 user nova-compute[71312]:   </nova:owner>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:ports>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:port uuid="682fce50-406a-4315-b5fc-b434a6c7c890">
Jul 25 10:03:11 user nova-compute[71312]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:03:11 user nova-compute[71312]:     </nova:port>
Jul 25 10:03:11 user nova-compute[71312]:   </nova:ports>
Jul 25 10:03:11 user nova-compute[71312]: </nova:instance>
Jul 25 10:03:11 user nova-compute[71312]:   </metadata>
Jul 25 10:03:11 user nova-compute[71312]:   <memory unit='KiB'>524288</memory>
Jul 25 10:03:11 user nova-compute[71312]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 25 10:03:11 user nova-compute[71312]:   <vcpu placement='static'>1</vcpu>
Jul 25 10:03:11 user nova-compute[71312]:   <resource>
Jul 25 10:03:11 user nova-compute[71312]:     <partition>/machine</partition>
Jul 25 10:03:11 user nova-compute[71312]:   </resource>
Jul 25 10:03:11 user nova-compute[71312]:   <sysinfo type='smbios'>
Jul 25 10:03:11 user nova-compute[71312]:     <system>
Jul 25 10:03:11 user nova-compute[71312]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 25 10:03:11 user nova-compute[71312]:       <entry name='product'>OpenStack Nova</entry>
Jul 25 10:03:11 user nova-compute[71312]:       <entry name='version'>0.0.0</entry>
Jul 25 10:03:11 user nova-compute[71312]:       <entry name='serial'>c918b5d0-e8f8-40cc-9c25-71ea69d08756</entry>
Jul 25 10:03:11 user nova-compute[71312]:       <entry name='uuid'>c918b5d0-e8f8-40cc-9c25-71ea69d08756</entry>
Jul 25 10:03:11 user nova-compute[71312]:       <entry name='family'>Virtual Machine</entry>
Jul 25 10:03:11 user nova-compute[71312]:     </system>
Jul 25 10:03:11 user nova-compute[71312]:   </sysinfo>
Jul 25 10:03:11 user nova-compute[71312]:   <os>
Jul 25 10:03:11 user nova-compute[71312]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 25 10:03:11 user nova-compute[71312]:     <boot dev='hd'/>
Jul 25 10:03:11 user nova-compute[71312]:     <smbios mode='sysinfo'/>
Jul 25 10:03:11 user nova-compute[71312]:   </os>
Jul 25 10:03:11 user nova-compute[71312]:   <features>
Jul 25 10:03:11 user nova-compute[71312]:     <acpi/>
Jul 25 10:03:11 user nova-compute[71312]:     <apic/>
Jul 25 10:03:11 user nova-compute[71312]:     <vmcoreinfo state='on'/>
Jul 25 10:03:11 user nova-compute[71312]:   </features>
Jul 25 10:03:11 user nova-compute[71312]:   <cpu mode='custom' match='exact' check='full'>
Jul 25 10:03:11 user nova-compute[71312]:     <model fallback='forbid'>Nehalem</model>
Jul 25 10:03:11 user nova-compute[71312]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 25 10:03:11 user nova-compute[71312]:     <feature policy='require' name='vme'/>
Jul 25 10:03:11 user nova-compute[71312]:     <feature policy='require' name='x2apic'/>
Jul 25 10:03:11 user nova-compute[71312]:     <feature policy='require' name='hypervisor'/>
Jul 25 10:03:11 user nova-compute[71312]:   </cpu>
Jul 25 10:03:11 user nova-compute[71312]:   <clock offset='utc'>
Jul 25 10:03:11 user nova-compute[71312]:     <timer name='pit' tickpolicy='delay'/>
Jul 25 10:03:11 user nova-compute[71312]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 25 10:03:11 user nova-compute[71312]:     <timer name='hpet' present='no'/>
Jul 25 10:03:11 user nova-compute[71312]:   </clock>
Jul 25 10:03:11 user nova-compute[71312]:   <on_poweroff>destroy</on_poweroff>
Jul 25 10:03:11 user nova-compute[71312]:   <on_reboot>restart</on_reboot>
Jul 25 10:03:11 user nova-compute[71312]:   <on_crash>destroy</on_crash>
Jul 25 10:03:11 user nova-compute[71312]:   <devices>
Jul 25 10:03:11 user nova-compute[71312]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 10:03:11 user nova-compute[71312]:     <disk type='file' device='disk'>
Jul 25 10:03:11 user nova-compute[71312]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 25 10:03:11 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk' index='2'/>
Jul 25 10:03:11 user nova-compute[71312]:       <backingStore type='file' index='3'>
Jul 25 10:03:11 user nova-compute[71312]:         <format type='raw'/>
Jul 25 10:03:11 user nova-compute[71312]:         <source file='/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62'/>
Jul 25 10:03:11 user nova-compute[71312]:         <backingStore/>
Jul 25 10:03:11 user nova-compute[71312]:       </backingStore>
Jul 25 10:03:11 user nova-compute[71312]:       <target dev='vda' bus='virtio'/>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='virtio-disk0'/>
Jul 25 10:03:11 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </disk>
Jul 25 10:03:11 user nova-compute[71312]:     <disk type='file' device='cdrom'>
Jul 25 10:03:11 user nova-compute[71312]:       <driver name='qemu' type='raw' cache='none'/>
Jul 25 10:03:11 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk.config' index='1'/>
Jul 25 10:03:11 user nova-compute[71312]:       <backingStore/>
Jul 25 10:03:11 user nova-compute[71312]:       <target dev='hda' bus='ide'/>
Jul 25 10:03:11 user nova-compute[71312]:       <readonly/>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='ide0-0-0'/>
Jul 25 10:03:11 user nova-compute[71312]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </disk>
Jul 25 10:03:11 user nova-compute[71312]:     <controller type='usb' index='0' model='none'>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='usb'/>
Jul 25 10:03:11 user nova-compute[71312]:     </controller>
Jul 25 10:03:11 user nova-compute[71312]:     <controller type='pci' index='0' model='pci-root'>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='pci.0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </controller>
Jul 25 10:03:11 user nova-compute[71312]:     <controller type='ide' index='0'>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='ide'/>
Jul 25 10:03:11 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 25 10:03:11 user nova-compute[71312]:     </controller>
Jul 25 10:03:11 user nova-compute[71312]:     <interface type='ethernet'>
Jul 25 10:03:11 user nova-compute[71312]:       <mac address='fa:16:3e:4a:96:ef'/>
Jul 25 10:03:11 user nova-compute[71312]:       <target dev='tap682fce50-40'/>
Jul 25 10:03:11 user nova-compute[71312]:       <model type='virtio'/>
Jul 25 10:03:11 user nova-compute[71312]:       <mtu size='1442'/>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='net0'/>
Jul 25 10:03:11 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </interface>
Jul 25 10:03:11 user nova-compute[71312]:     <serial type='pty'>
Jul 25 10:03:11 user nova-compute[71312]:       <source path='/dev/pts/8'/>
Jul 25 10:03:11 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/console.log' append='off'/>
Jul 25 10:03:11 user nova-compute[71312]:       <target type='isa-serial' port='0'>
Jul 25 10:03:11 user nova-compute[71312]:         <model name='isa-serial'/>
Jul 25 10:03:11 user nova-compute[71312]:       </target>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='serial0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </serial>
Jul 25 10:03:11 user nova-compute[71312]:     <console type='pty' tty='/dev/pts/8'>
Jul 25 10:03:11 user nova-compute[71312]:       <source path='/dev/pts/8'/>
Jul 25 10:03:11 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/console.log' append='off'/>
Jul 25 10:03:11 user nova-compute[71312]:       <target type='serial' port='0'/>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='serial0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </console>
Jul 25 10:03:11 user nova-compute[71312]:     <input type='mouse' bus='ps2'>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='input0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </input>
Jul 25 10:03:11 user nova-compute[71312]:     <input type='keyboard' bus='ps2'>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='input1'/>
Jul 25 10:03:11 user nova-compute[71312]:     </input>
Jul 25 10:03:11 user nova-compute[71312]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 25 10:03:11 user nova-compute[71312]:       <listen type='address' address='0.0.0.0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </graphics>
Jul 25 10:03:11 user nova-compute[71312]:     <audio id='1' type='none'/>
Jul 25 10:03:11 user nova-compute[71312]:     <video>
Jul 25 10:03:11 user nova-compute[71312]:       <model type='virtio' heads='1' primary='yes'/>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='video0'/>
Jul 25 10:03:11 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </video>
Jul 25 10:03:11 user nova-compute[71312]:     <memballoon model='virtio'>
Jul 25 10:03:11 user nova-compute[71312]:       <stats period='10'/>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='balloon0'/>
Jul 25 10:03:11 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </memballoon>
Jul 25 10:03:11 user nova-compute[71312]:     <rng model='virtio'>
Jul 25 10:03:11 user nova-compute[71312]:       <backend model='random'>/dev/urandom</backend>
Jul 25 10:03:11 user nova-compute[71312]:       <alias name='rng0'/>
Jul 25 10:03:11 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 25 10:03:11 user nova-compute[71312]:     </rng>
Jul 25 10:03:11 user nova-compute[71312]:   </devices>
Jul 25 10:03:11 user nova-compute[71312]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 25 10:03:11 user nova-compute[71312]:     <label>libvirt-c918b5d0-e8f8-40cc-9c25-71ea69d08756</label>
Jul 25 10:03:11 user nova-compute[71312]:     <imagelabel>libvirt-c918b5d0-e8f8-40cc-9c25-71ea69d08756</imagelabel>
Jul 25 10:03:11 user nova-compute[71312]:   </seclabel>
Jul 25 10:03:11 user nova-compute[71312]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 25 10:03:11 user nova-compute[71312]:     <label>+64055:+108</label>
Jul 25 10:03:11 user nova-compute[71312]:     <imagelabel>+64055:+108</imagelabel>
Jul 25 10:03:11 user nova-compute[71312]:   </seclabel>
Jul 25 10:03:11 user nova-compute[71312]: </domain>
Jul 25 10:03:11 user nova-compute[71312]:  {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 25 10:03:11 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Detaching interface fa:16:3e:df:13:71 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapab8bcb60-9a' not found.
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-282503515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-282503515',id=9,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfqLhAiM/fPqXox/lYYvHbsORMvG7EmhROMdWtJDW0gFjkybugS0JoPzqPg5A//Q1NyXk2q9pHeiid5wc4meqjPqIfzYlQ74CfLabiQCTkCNSfq5sY3vsH1zVkcnvVCvw==',key_name='tempest-keypair-791003982',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:01:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b5086ef6cce4cdfafc4a061ab06f894',ramdisk_id='',reservation_id='r-g6z0fs1a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1298550074',owner_user_name='tempest-TaggedAttachmentsTest-1298550074-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6325c3b752a4cd88b584d9acd06d537',uuid=c918b5d0-e8f8-40cc-9c25-71ea69d08756,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "address": "fa:16:3e:df:13:71", "network": {"id": "75cf6071-7351-481a-8cf4-bf1c01ecc586", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1467023115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8bcb60-9a", "ovs_interfaceid": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] Converting VIF {"id": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "address": "fa:16:3e:df:13:71", "network": {"id": "75cf6071-7351-481a-8cf4-bf1c01ecc586", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1467023115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8bcb60-9a", "ovs_interfaceid": "ab8bcb60-9a8d-45e3-98cf-16703689f2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:13:71,bridge_name='br-int',has_traffic_filtering=True,id=ab8bcb60-9a8d-45e3-98cf-16703689f2e1,network=Network(75cf6071-7351-481a-8cf4-bf1c01ecc586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8bcb60-9a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG os_vif [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:13:71,bridge_name='br-int',has_traffic_filtering=True,id=ab8bcb60-9a8d-45e3-98cf-16703689f2e1,network=Network(75cf6071-7351-481a-8cf4-bf1c01ecc586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8bcb60-9a') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab8bcb60-9a, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:03:11 user nova-compute[71312]: INFO os_vif [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:13:71,bridge_name='br-int',has_traffic_filtering=True,id=ab8bcb60-9a8d-45e3-98cf-16703689f2e1,network=Network(75cf6071-7351-481a-8cf4-bf1c01ecc586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8bcb60-9a')
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [req-9135ac72-6a98-4c63-836c-7d34600faafa req-09369633-e3e8-4759-8b7b-043a0cd8d309 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:03:11 user nova-compute[71312]:   <nova:package version="0.0.0"/>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:name>tempest-device-tagging-server-282503515</nova:name>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:creationTime>2023-07-25 10:03:11</nova:creationTime>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:flavor name="m1.tiny">
Jul 25 10:03:11 user nova-compute[71312]:     <nova:memory>512</nova:memory>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:disk>1</nova:disk>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:swap>0</nova:swap>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:vcpus>1</nova:vcpus>
Jul 25 10:03:11 user nova-compute[71312]:   </nova:flavor>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:owner>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:user uuid="d6325c3b752a4cd88b584d9acd06d537">tempest-TaggedAttachmentsTest-1298550074-project-member</nova:user>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:project uuid="5b5086ef6cce4cdfafc4a061ab06f894">tempest-TaggedAttachmentsTest-1298550074</nova:project>
Jul 25 10:03:11 user nova-compute[71312]:   </nova:owner>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:03:11 user nova-compute[71312]:   <nova:ports>
Jul 25 10:03:11 user nova-compute[71312]:     <nova:port uuid="682fce50-406a-4315-b5fc-b434a6c7c890">
Jul 25 10:03:11 user nova-compute[71312]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:03:11 user nova-compute[71312]:     </nova:port>
Jul 25 10:03:11 user nova-compute[71312]:   </nova:ports>
Jul 25 10:03:11 user nova-compute[71312]: </nova:instance>
Jul 25 10:03:11 user nova-compute[71312]:  {{(pid=71312) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Updating instance_info_cache with network_info: [{"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Releasing lock "refresh_cache-c918b5d0-e8f8-40cc-9c25-71ea69d08756" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:03:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d77bc1f8-4d5d-40da-b2fb-dfa4a4177eab tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "interface-c918b5d0-e8f8-40cc-9c25-71ea69d08756-ab8bcb60-9a8d-45e3-98cf-16703689f2e1" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.641s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-7f7e93b5-f87e-45fc-abf0-8acd828a917a req-e50ade81-9da9-41da-8642-806a99d0a2ee service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received event network-vif-plugged-ab8bcb60-9a8d-45e3-98cf-16703689f2e1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7f7e93b5-f87e-45fc-abf0-8acd828a917a req-e50ade81-9da9-41da-8642-806a99d0a2ee service nova] Acquiring lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7f7e93b5-f87e-45fc-abf0-8acd828a917a req-e50ade81-9da9-41da-8642-806a99d0a2ee service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7f7e93b5-f87e-45fc-abf0-8acd828a917a req-e50ade81-9da9-41da-8642-806a99d0a2ee service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-7f7e93b5-f87e-45fc-abf0-8acd828a917a req-e50ade81-9da9-41da-8642-806a99d0a2ee service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] No waiting events found dispatching network-vif-plugged-ab8bcb60-9a8d-45e3-98cf-16703689f2e1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:12 user nova-compute[71312]: WARNING nova.compute.manager [req-7f7e93b5-f87e-45fc-abf0-8acd828a917a req-e50ade81-9da9-41da-8642-806a99d0a2ee service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received unexpected event network-vif-plugged-ab8bcb60-9a8d-45e3-98cf-16703689f2e1 for instance with vm_state active and task_state None.
Jul 25 10:03:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpNAGXzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:03:14 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:03:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:03:14 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:03:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:03:14 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3accf848-cffc-4124-aaa7-d443f20fcdcb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:03:14 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21be240-8484-47ef-8147-093b3cfd49c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52] added
Jul 25 10:03:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce89e41c-9110-490e-bdd4-5dfa39ce9cd8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7682e69-43ac-4f82-9038-2f3abc14895d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpNAGXzc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpNAGXzc" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd17983-f260-4931-b21b-47a72024ea92]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VpNAGXzc'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4168de3f-9dff-4c5f-ab50-a52d5442c521]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cca3c4-7e06-429d-9f1a-0661f3654194]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:03:14 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:14 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:14 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:14 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:03:14 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:14 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:14 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:14 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[af39c17c-53f3-4b22-bd48-e908719b6b25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52, portal: 172.16.0.220,3260]
Jul 25 10:03:15 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52, portal: 172.16.0.220,3260] successful.
Jul 25 10:03:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ad19e7-82ab-4cbd-ae4e-87ee92d98011]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a47864b-9581-43a9-bff9-97da1d354ffc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 (non-flash)
Jul 25 10:03:15 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:03:15 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:15 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:15 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:15 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 (non-flash)
Jul 25 10:03:15 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:03:15 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:15 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:15 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:15 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[95095307-0167-43f2-969b-f2d21b5b436e]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpNAGXzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:03:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:03:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23166333665333637', 'path': '/dev/sdg'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:03:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166333665333637', 'path': '/dev/sdg'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:03:16 user nova-compute[71312]: DEBUG nova.objects.instance [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lazy-loading 'flavor' on Instance uuid d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:03:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:03:16 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:03:16 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:03:16 user nova-compute[71312]:   <target dev="sdc" bus="scsi"/>
Jul 25 10:03:16 user nova-compute[71312]:   <serial>1436450a-b98c-4ed2-aadb-287eb63d8e52</serial>
Jul 25 10:03:16 user nova-compute[71312]:   <address type="drive" controller="0" unit="2"/>
Jul 25 10:03:16 user nova-compute[71312]: </disk>
Jul 25 10:03:16 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:03:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] No BDM found with device name sda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:03:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:03:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:03:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] No VIF found with MAC fa:16:3e:e2:13:bd, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:03:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-030cc984-1417-4d4a-8792-3a8f7237655f tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.334s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:18 user nova-compute[71312]: INFO nova.compute.manager [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Detaching volume 1436450a-b98c-4ed2-aadb-287eb63d8e52
Jul 25 10:03:18 user nova-compute[71312]: INFO nova.virt.block_device [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Attempting to driver detach volume 1436450a-b98c-4ed2-aadb-287eb63d8e52 from mountpoint /dev/sdc
Jul 25 10:03:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Attempting to detach device sdc from instance d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:03:18 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:03:18 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:03:18 user nova-compute[71312]:   <target dev="sdc" bus="scsi"/>
Jul 25 10:03:18 user nova-compute[71312]:   <serial>1436450a-b98c-4ed2-aadb-287eb63d8e52</serial>
Jul 25 10:03:18 user nova-compute[71312]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 25 10:03:18 user nova-compute[71312]: </disk>
Jul 25 10:03:18 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:03:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Successfully detached device sdc from instance d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 from the persistent domain config.
Jul 25 10:03:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:03:18 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:03:18 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:03:18 user nova-compute[71312]:   <target dev="sdc" bus="scsi"/>
Jul 25 10:03:18 user nova-compute[71312]:   <serial>1436450a-b98c-4ed2-aadb-287eb63d8e52</serial>
Jul 25 10:03:18 user nova-compute[71312]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 25 10:03:18 user nova-compute[71312]: </disk>
Jul 25 10:03:18 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279398.819768, d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:03:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Successfully detached device sdc from instance d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 from the live domain config.
Jul 25 10:03:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpNAGXzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:03:18 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:03:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d517a79-7673-4de6-b3af-03a6e6353db3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:03:18 user nova-compute[71312]: No targets found.
Jul 25 10:03:18 user nova-compute[71312]: iSNS:
Jul 25 10:03:18 user nova-compute[71312]: No targets found.
Jul 25 10:03:18 user nova-compute[71312]: STATIC:
Jul 25 10:03:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec
Jul 25 10:03:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496
Jul 25 10:03:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343
Jul 25 10:03:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9
Jul 25 10:03:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:03:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52
Jul 25 10:03:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:18 user nova-compute[71312]: FIRMWARE:
Jul 25 10:03:18 user nova-compute[71312]: No targets found.
Jul 25 10:03:18 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:03:18 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:03:18 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[690e7902-0802-4899-9b1e-d0bbe65a4325]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a73a842-8c0f-4d84-b270-b7737a88ea03]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 (non-flash)
Jul 25 10:03:18 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:03:18 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:18 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:18 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:18 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:18 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 (non-flash)
Jul 25 10:03:18 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:03:18 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:18 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:18 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:18 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:18 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c0166b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52'): ({'sdg'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Removing single pathed devices sdg {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1933ec-e2a5-4dc9-97f8-1be9c4568ad1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2303a01-26ee-417e-b5c1-fc9a190c20ec]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Flushing IO for device /dev/sdg {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0c60db-b881-40cd-8636-4613d6d28be9]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:03:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec19d0a-ff2c-4fdf-8218-ee577b4e1db6]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0daa24-9e89-4e1f-9db0-f44b7d710b9d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[592a85b0-5ec2-4703-953f-8004b38c9945]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52, portal: 172.16.0.220,3260]
Jul 25 10:03:19 user nova-compute[71312]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52, portal: 172.16.0.220,3260] successful.
Jul 25 10:03:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1436450a-b98c-4ed2-aadb-287eb63d8e52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[150028f7-82a2-4433-b539-2909bcf89b0a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] <== disconnect_volume: return (351ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:03:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:03:20 user nova-compute[71312]: DEBUG nova.objects.instance [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lazy-loading 'flavor' on Instance uuid d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:03:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-39715273-c96c-4728-a842-dc1c59b3ebe2 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.694s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:20 user nova-compute[71312]: INFO nova.compute.manager [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Terminating instance
Jul 25 10:03:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:03:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-4b1aec70-2395-4fec-876d-193bd302cb73 req-c93a7356-6abd-42d0-a6d1-3760931d1da6 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Received event network-vif-unplugged-1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4b1aec70-2395-4fec-876d-193bd302cb73 req-c93a7356-6abd-42d0-a6d1-3760931d1da6 service nova] Acquiring lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4b1aec70-2395-4fec-876d-193bd302cb73 req-c93a7356-6abd-42d0-a6d1-3760931d1da6 service nova] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4b1aec70-2395-4fec-876d-193bd302cb73 req-c93a7356-6abd-42d0-a6d1-3760931d1da6 service nova] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-4b1aec70-2395-4fec-876d-193bd302cb73 req-c93a7356-6abd-42d0-a6d1-3760931d1da6 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] No waiting events found dispatching network-vif-unplugged-1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-4b1aec70-2395-4fec-876d-193bd302cb73 req-c93a7356-6abd-42d0-a6d1-3760931d1da6 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Received event network-vif-unplugged-1022b294-bd18-485e-a79a-25d9a11b6e42 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:03:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Instance destroyed successfully.
Jul 25 10:03:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lazy-loading 'resources' on Instance uuid d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1357350949',display_name='tempest-AttachSCSIVolumeTestJSON-server-1357350949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1357350949',id=10,image_ref='688e4d28-2f51-4eeb-a136-06b40da73ac0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXEA+71avj89VbYClk00a8HT4J+zXMYN9DdWA6hh8jWaZSg9IkLIXSSWMqfWLeqbEP7IDChHSl3HAxapVcYmIWnM7WL4HgwsM62s/SPxNBVsff7wSlV3XoC0/rv0xlZIw==',key_name='tempest-keypair-838100764',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='596d8ef54bf748bf8564c8be39d028ff',ramdisk_id='',reservation_id='r-8mm9djqj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='688e4d28-2f51-4eeb-a136-06b40da73ac0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1704055171',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1704055171-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6d67152f5984cfb97ced29a539956e6',uuid=d5af1891-6ce7-408d-9f4d-9c5ecfe601b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1022b294-bd18-485e-a79a-25d9a11b6e42", "address": "fa:16:3e:e2:13:bd", "network": {"id": "0cebbe11-b08a-472b-b7d3-db59047dabfd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-202502212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "596d8ef54bf748bf8564c8be39d028ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1022b294-bd", "ovs_interfaceid": "1022b294-bd18-485e-a79a-25d9a11b6e42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Converting VIF {"id": "1022b294-bd18-485e-a79a-25d9a11b6e42", "address": "fa:16:3e:e2:13:bd", "network": {"id": "0cebbe11-b08a-472b-b7d3-db59047dabfd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-202502212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "596d8ef54bf748bf8564c8be39d028ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1022b294-bd", "ovs_interfaceid": "1022b294-bd18-485e-a79a-25d9a11b6e42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:13:bd,bridge_name='br-int',has_traffic_filtering=True,id=1022b294-bd18-485e-a79a-25d9a11b6e42,network=Network(0cebbe11-b08a-472b-b7d3-db59047dabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1022b294-bd') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG os_vif [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:13:bd,bridge_name='br-int',has_traffic_filtering=True,id=1022b294-bd18-485e-a79a-25d9a11b6e42,network=Network(0cebbe11-b08a-472b-b7d3-db59047dabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1022b294-bd') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1022b294-bd, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:21 user nova-compute[71312]: INFO os_vif [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:13:bd,bridge_name='br-int',has_traffic_filtering=True,id=1022b294-bd18-485e-a79a-25d9a11b6e42,network=Network(0cebbe11-b08a-472b-b7d3-db59047dabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1022b294-bd')
Jul 25 10:03:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Deleting instance files /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3_del
Jul 25 10:03:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Deletion of /opt/stack/data/nova/instances/d5af1891-6ce7-408d-9f4d-9c5ecfe601b3_del complete
Jul 25 10:03:21 user nova-compute[71312]: INFO nova.compute.manager [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 25 10:03:21 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:03:21 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:03:23 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-04fd1e02-1e0b-43fb-8864-8aca21d294e1 req-0533f815-535c-481d-909b-c99dfa4b4786 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Received event network-vif-plugged-1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04fd1e02-1e0b-43fb-8864-8aca21d294e1 req-0533f815-535c-481d-909b-c99dfa4b4786 service nova] Acquiring lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04fd1e02-1e0b-43fb-8864-8aca21d294e1 req-0533f815-535c-481d-909b-c99dfa4b4786 service nova] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04fd1e02-1e0b-43fb-8864-8aca21d294e1 req-0533f815-535c-481d-909b-c99dfa4b4786 service nova] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-04fd1e02-1e0b-43fb-8864-8aca21d294e1 req-0533f815-535c-481d-909b-c99dfa4b4786 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] No waiting events found dispatching network-vif-plugged-1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:23 user nova-compute[71312]: WARNING nova.compute.manager [req-04fd1e02-1e0b-43fb-8864-8aca21d294e1 req-0533f815-535c-481d-909b-c99dfa4b4786 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Received unexpected event network-vif-plugged-1022b294-bd18-485e-a79a-25d9a11b6e42 for instance with vm_state active and task_state deleting.
Jul 25 10:03:23 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Took 1.76 seconds to deallocate network for instance.
Jul 25 10:03:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-85f31ab3-2cda-4802-ae5d-237f2f9f0f88 req-f3722109-ca9d-495f-b261-acd0e4d27db3 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Received event network-vif-deleted-1022b294-bd18-485e-a79a-25d9a11b6e42 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:23 user nova-compute[71312]: INFO nova.compute.manager [req-85f31ab3-2cda-4802-ae5d-237f2f9f0f88 req-f3722109-ca9d-495f-b261-acd0e4d27db3 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Neutron deleted interface 1022b294-bd18-485e-a79a-25d9a11b6e42; detaching it from the instance and deleting it from the info cache
Jul 25 10:03:23 user nova-compute[71312]: DEBUG nova.network.neutron [req-85f31ab3-2cda-4802-ae5d-237f2f9f0f88 req-f3722109-ca9d-495f-b261-acd0e4d27db3 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-85f31ab3-2cda-4802-ae5d-237f2f9f0f88 req-f3722109-ca9d-495f-b261-acd0e4d27db3 service nova] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Detach interface failed, port_id=1022b294-bd18-485e-a79a-25d9a11b6e42, reason: Instance d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:03:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:23 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:03:23 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:03:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:24 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Deleted allocations for instance d5af1891-6ce7-408d-9f4d-9c5ecfe601b3
Jul 25 10:03:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7cf223ed-0598-4a83-b7e1-cd24e5369f03 tempest-AttachSCSIVolumeTestJSON-1704055171 tempest-AttachSCSIVolumeTestJSON-1704055171-project-member] Lock "d5af1891-6ce7-408d-9f4d-9c5ecfe601b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.236s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:03:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:03:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:03:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:03:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:03:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:03:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Updating instance_info_cache with network_info: [{"id": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "address": "fa:16:3e:60:b3:44", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d07c46c-fb", "ovs_interfaceid": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:03:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:03:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:30 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:03:30 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7114MB free_disk=25.503787994384766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9fb85501-6210-4bfd-b496-1891c79fd23c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 297fe407-3797-4681-ba83-e0f296780d57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 50f8683d-8b60-4095-9507-a969c37f85e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance c918b5d0-e8f8-40cc-9c25-71ea69d08756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1724}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:03:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:03:31 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:03:31 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:03:31 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:03:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.369s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:03:31 user nova-compute[71312]: INFO nova.compute.claims [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Claim successful on node user
Jul 25 10:03:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:31 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:03:31 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:03:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:03:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:03:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:03:31 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:03:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:03:31 user nova-compute[71312]: INFO nova.virt.block_device [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Booting with blank volume at /dev/vda
Jul 25 10:03:31 user nova-compute[71312]: DEBUG nova.policy [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96d25383d4b6448da2d30479a26bfa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14fcd7739f41eabc9e7120f5b58a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:03:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Successfully created port: 3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:03:33 user nova-compute[71312]: DEBUG nova.network.neutron [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Successfully updated port: 3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:03:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:03:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquired lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:03:33 user nova-compute[71312]: DEBUG nova.network.neutron [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:03:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ba04edd-f413-490e-b676-a656391ad58c req-70bd21e3-5264-4bda-91cf-6dce7d82363c service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-changed-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ba04edd-f413-490e-b676-a656391ad58c req-70bd21e3-5264-4bda-91cf-6dce7d82363c service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Refreshing instance network info cache due to event network-changed-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:03:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ba04edd-f413-490e-b676-a656391ad58c req-70bd21e3-5264-4bda-91cf-6dce7d82363c service nova] Acquiring lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:03:33 user nova-compute[71312]: DEBUG nova.network.neutron [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:03:33 user nova-compute[71312]: DEBUG nova.network.neutron [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Updating instance_info_cache with network_info: [{"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Releasing lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:03:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Instance network_info: |[{"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:03:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ba04edd-f413-490e-b676-a656391ad58c req-70bd21e3-5264-4bda-91cf-6dce7d82363c service nova] Acquired lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:03:33 user nova-compute[71312]: DEBUG nova.network.neutron [req-1ba04edd-f413-490e-b676-a656391ad58c req-70bd21e3-5264-4bda-91cf-6dce7d82363c service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Refreshing network info cache for port 3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:03:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:34 user nova-compute[71312]: DEBUG nova.network.neutron [req-1ba04edd-f413-490e-b676-a656391ad58c req-70bd21e3-5264-4bda-91cf-6dce7d82363c service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Updated VIF entry in instance network info cache for port 3fa3349e-fba2-4bba-a1cb-1ef17e40f35a. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:03:34 user nova-compute[71312]: DEBUG nova.network.neutron [req-1ba04edd-f413-490e-b676-a656391ad58c req-70bd21e3-5264-4bda-91cf-6dce7d82363c service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Updating instance_info_cache with network_info: [{"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ba04edd-f413-490e-b676-a656391ad58c req-70bd21e3-5264-4bda-91cf-6dce7d82363c service nova] Releasing lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:03:36 user nova-compute[71312]: INFO nova.compute.claims [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Claim successful on node user
Jul 25 10:03:36 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279401.6320066, d5af1891-6ce7-408d-9f4d-9c5ecfe601b3 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:03:36 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] VM Stopped (Lifecycle Event)
Jul 25 10:03:36 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5b84059b-b4d2-4a14-b72b-95c87ca2a1b4 None None] [instance: d5af1891-6ce7-408d-9f4d-9c5ecfe601b3] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:03:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:03:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:03:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Creating image(s)
Jul 25 10:03:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "/opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "/opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.149s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG nova.policy [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f7533403acd4dc7a410015efa392724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e67aaa7e94f2ab8d700776bc203e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk 1073741824" returned: 0 in 0.059s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG os_brick.utils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2e1b77-e1aa-42ea-98ff-abaeb895a224]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b268017-a188-47c8-b25d-c9f32a9450bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2cd31c-7dac-4285-986c-8ba5d605a72b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7da394-0148-4162-8d12-9fad7a4ecb72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:03:37 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa847527-1db8-40cf-909b-cbf4a252f3b1]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG os_brick.utils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Updating existing volume attachment record: 3e62b5ad-a285-4c19-a715-a8ae5324492f {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Cannot resize image /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'migration_context' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Ensure instance console log exists: /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-99d4cabe-b6e7-4caf-9e0d-07be6f5dd8cf req-0bcdbcc9-eefd-4c50-9d1b-4061d1d160cc service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-changed-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-99d4cabe-b6e7-4caf-9e0d-07be6f5dd8cf req-0bcdbcc9-eefd-4c50-9d1b-4061d1d160cc service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing instance network info cache due to event network-changed-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:03:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99d4cabe-b6e7-4caf-9e0d-07be6f5dd8cf req-0bcdbcc9-eefd-4c50-9d1b-4061d1d160cc service nova] Acquiring lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:03:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99d4cabe-b6e7-4caf-9e0d-07be6f5dd8cf req-0bcdbcc9-eefd-4c50-9d1b-4061d1d160cc service nova] Acquired lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:03:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-99d4cabe-b6e7-4caf-9e0d-07be6f5dd8cf req-0bcdbcc9-eefd-4c50-9d1b-4061d1d160cc service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Refreshing network info cache for port 8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:03:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Successfully created port: 21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:03:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-99d4cabe-b6e7-4caf-9e0d-07be6f5dd8cf req-0bcdbcc9-eefd-4c50-9d1b-4061d1d160cc service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updated VIF entry in instance network info cache for port 8e6bdd57-e2ac-4de4-bfb6-a2e511203f21. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:03:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-99d4cabe-b6e7-4caf-9e0d-07be6f5dd8cf req-0bcdbcc9-eefd-4c50-9d1b-4061d1d160cc service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating instance_info_cache with network_info: [{"id": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "address": "fa:16:3e:4b:a2:8f", "network": {"id": "8c9da59c-8815-4721-baf9-4931ceb98e10", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1623323297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6bdd57-e2", "ovs_interfaceid": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81060ccd-4ba6-4d40-b340-320cfa254f38", "address": "fa:16:3e:1b:2f:74", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81060ccd-4b", "ovs_interfaceid": "81060ccd-4ba6-4d40-b340-320cfa254f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "address": "fa:16:3e:27:68:29", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468cbd00-2f", "ovs_interfaceid": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "address": "fa:16:3e:20:5d:92", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90ea84d-dc", "ovs_interfaceid": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99d4cabe-b6e7-4caf-9e0d-07be6f5dd8cf req-0bcdbcc9-eefd-4c50-9d1b-4061d1d160cc service nova] Releasing lock "refresh_cache-7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:03:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Successfully updated port: 21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "refresh_cache-8d5e4107-7c28-4c75-aa0a-9e467f0536d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquired lock "refresh_cache-8d5e4107-7c28-4c75-aa0a-9e467f0536d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-628a3b16-6c3e-4cb3-b108-ce240a49bd99 req-d5019ad6-efa2-471b-a2aa-adc98cc4a9c0 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Received event network-changed-21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-628a3b16-6c3e-4cb3-b108-ce240a49bd99 req-d5019ad6-efa2-471b-a2aa-adc98cc4a9c0 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Refreshing instance network info cache due to event network-changed-21d54204-0541-4b46-9c4b-13a826123e4a. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-628a3b16-6c3e-4cb3-b108-ce240a49bd99 req-d5019ad6-efa2-471b-a2aa-adc98cc4a9c0 service nova] Acquiring lock "refresh_cache-8d5e4107-7c28-4c75-aa0a-9e467f0536d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Updating instance_info_cache with network_info: [{"id": "21d54204-0541-4b46-9c4b-13a826123e4a", "address": "fa:16:3e:30:3b:71", "network": {"id": "07adb718-1379-4f03-80cb-84fb5ea2f086", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1044212390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c3e67aaa7e94f2ab8d700776bc203e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d54204-05", "ovs_interfaceid": "21d54204-0541-4b46-9c4b-13a826123e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Releasing lock "refresh_cache-8d5e4107-7c28-4c75-aa0a-9e467f0536d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Instance network_info: |[{"id": "21d54204-0541-4b46-9c4b-13a826123e4a", "address": "fa:16:3e:30:3b:71", "network": {"id": "07adb718-1379-4f03-80cb-84fb5ea2f086", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1044212390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c3e67aaa7e94f2ab8d700776bc203e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d54204-05", "ovs_interfaceid": "21d54204-0541-4b46-9c4b-13a826123e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-628a3b16-6c3e-4cb3-b108-ce240a49bd99 req-d5019ad6-efa2-471b-a2aa-adc98cc4a9c0 service nova] Acquired lock "refresh_cache-8d5e4107-7c28-4c75-aa0a-9e467f0536d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-628a3b16-6c3e-4cb3-b108-ce240a49bd99 req-d5019ad6-efa2-471b-a2aa-adc98cc4a9c0 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Refreshing network info cache for port 21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Start _get_guest_xml network_info=[{"id": "21d54204-0541-4b46-9c4b-13a826123e4a", "address": "fa:16:3e:30:3b:71", "network": {"id": "07adb718-1379-4f03-80cb-84fb5ea2f086", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1044212390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c3e67aaa7e94f2ab8d700776bc203e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d54204-05", "ovs_interfaceid": "21d54204-0541-4b46-9c4b-13a826123e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:03:40 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:03:40 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1061246116',display_name='tempest-SnapshotDataIntegrityTests-server-1061246116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1061246116',id=14,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtjccPguT409ZXRU6u7UoQUOgW9/tET9J5QtvrXhkszx0vFHXoPt0oBZuHwAltGGPwFP4jxAK4qRYyHhKsbR5Z0cppn5k/q4v7peCa+3lt+wBmB33LSpOftA29SFYsghQ==',key_name='tempest-keypair-449794532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c3e67aaa7e94f2ab8d700776bc203e4',ramdisk_id='',reservation_id='r-a3vh9se2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-872571308',owner_user_name='tempest-SnapshotDataIntegrityTests-872571308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f7533403acd4dc7a410015efa392724',uuid=8d5e4107-7c28-4c75-aa0a-9e467f0536d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21d54204-0541-4b46-9c4b-13a826123e4a", "address": "fa:16:3e:30:3b:71", "network": {"id": "07adb718-1379-4f03-80cb-84fb5ea2f086", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1044212390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c3e67aaa7e94f2ab8d700776bc203e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d54204-05", "ovs_interfaceid": "21d54204-0541-4b46-9c4b-13a826123e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Converting VIF {"id": "21d54204-0541-4b46-9c4b-13a826123e4a", "address": "fa:16:3e:30:3b:71", "network": {"id": "07adb718-1379-4f03-80cb-84fb5ea2f086", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1044212390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c3e67aaa7e94f2ab8d700776bc203e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d54204-05", "ovs_interfaceid": "21d54204-0541-4b46-9c4b-13a826123e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3b:71,bridge_name='br-int',has_traffic_filtering=True,id=21d54204-0541-4b46-9c4b-13a826123e4a,network=Network(07adb718-1379-4f03-80cb-84fb5ea2f086),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d54204-05') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:03:40 user nova-compute[71312]:   <uuid>8d5e4107-7c28-4c75-aa0a-9e467f0536d6</uuid>
Jul 25 10:03:40 user nova-compute[71312]:   <name>instance-0000000e</name>
Jul 25 10:03:40 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:03:40 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:03:40 user nova-compute[71312]:   <metadata>
Jul 25 10:03:40 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:03:40 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:03:40 user nova-compute[71312]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1061246116</nova:name>
Jul 25 10:03:40 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:03:40</nova:creationTime>
Jul 25 10:03:40 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:03:40 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:03:40 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:03:40 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:03:40 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:03:40 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:03:40 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:03:40 user nova-compute[71312]:       <nova:owner>
Jul 25 10:03:40 user nova-compute[71312]:         <nova:user uuid="1f7533403acd4dc7a410015efa392724">tempest-SnapshotDataIntegrityTests-872571308-project-member</nova:user>
Jul 25 10:03:40 user nova-compute[71312]:         <nova:project uuid="2c3e67aaa7e94f2ab8d700776bc203e4">tempest-SnapshotDataIntegrityTests-872571308</nova:project>
Jul 25 10:03:40 user nova-compute[71312]:       </nova:owner>
Jul 25 10:03:40 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:03:40 user nova-compute[71312]:       <nova:ports>
Jul 25 10:03:40 user nova-compute[71312]:         <nova:port uuid="21d54204-0541-4b46-9c4b-13a826123e4a">
Jul 25 10:03:40 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 10:03:40 user nova-compute[71312]:         </nova:port>
Jul 25 10:03:40 user nova-compute[71312]:       </nova:ports>
Jul 25 10:03:40 user nova-compute[71312]:     </nova:instance>
Jul 25 10:03:40 user nova-compute[71312]:   </metadata>
Jul 25 10:03:40 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:03:40 user nova-compute[71312]:     <system>
Jul 25 10:03:40 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:03:40 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:03:40 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:03:40 user nova-compute[71312]:       <entry name="serial">8d5e4107-7c28-4c75-aa0a-9e467f0536d6</entry>
Jul 25 10:03:40 user nova-compute[71312]:       <entry name="uuid">8d5e4107-7c28-4c75-aa0a-9e467f0536d6</entry>
Jul 25 10:03:40 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:03:40 user nova-compute[71312]:     </system>
Jul 25 10:03:40 user nova-compute[71312]:   </sysinfo>
Jul 25 10:03:40 user nova-compute[71312]:   <os>
Jul 25 10:03:40 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:03:40 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:03:40 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:03:40 user nova-compute[71312]:   </os>
Jul 25 10:03:40 user nova-compute[71312]:   <features>
Jul 25 10:03:40 user nova-compute[71312]:     <acpi/>
Jul 25 10:03:40 user nova-compute[71312]:     <apic/>
Jul 25 10:03:40 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:03:40 user nova-compute[71312]:   </features>
Jul 25 10:03:40 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:03:40 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:03:40 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:03:40 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:03:40 user nova-compute[71312]:   </clock>
Jul 25 10:03:40 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:03:40 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:03:40 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:03:40 user nova-compute[71312]:   </cpu>
Jul 25 10:03:40 user nova-compute[71312]:   <devices>
Jul 25 10:03:40 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:03:40 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:03:40 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk"/>
Jul 25 10:03:40 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:03:40 user nova-compute[71312]:     </disk>
Jul 25 10:03:40 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:03:40 user nova-compute[71312]:       <mac address="fa:16:3e:30:3b:71"/>
Jul 25 10:03:40 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:03:40 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:03:40 user nova-compute[71312]:       <target dev="tap21d54204-05"/>
Jul 25 10:03:40 user nova-compute[71312]:     </interface>
Jul 25 10:03:40 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:03:40 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/console.log" append="off"/>
Jul 25 10:03:40 user nova-compute[71312]:     </serial>
Jul 25 10:03:40 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:03:40 user nova-compute[71312]:     <video>
Jul 25 10:03:40 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:03:40 user nova-compute[71312]:     </video>
Jul 25 10:03:40 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:03:40 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:03:40 user nova-compute[71312]:     </rng>
Jul 25 10:03:40 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:03:40 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:03:40 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:03:40 user nova-compute[71312]:     </memballoon>
Jul 25 10:03:40 user nova-compute[71312]:   </devices>
Jul 25 10:03:40 user nova-compute[71312]: </domain>
Jul 25 10:03:40 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1061246116',display_name='tempest-SnapshotDataIntegrityTests-server-1061246116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1061246116',id=14,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtjccPguT409ZXRU6u7UoQUOgW9/tET9J5QtvrXhkszx0vFHXoPt0oBZuHwAltGGPwFP4jxAK4qRYyHhKsbR5Z0cppn5k/q4v7peCa+3lt+wBmB33LSpOftA29SFYsghQ==',key_name='tempest-keypair-449794532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c3e67aaa7e94f2ab8d700776bc203e4',ramdisk_id='',reservation_id='r-a3vh9se2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-872571308',owner_user_name='tempest-SnapshotDataIntegrityTests-872571308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f7533403acd4dc7a410015efa392724',uuid=8d5e4107-7c28-4c75-aa0a-9e467f0536d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21d54204-0541-4b46-9c4b-13a826123e4a", "address": "fa:16:3e:30:3b:71", "network": {"id": "07adb718-1379-4f03-80cb-84fb5ea2f086", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1044212390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c3e67aaa7e94f2ab8d700776bc203e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d54204-05", "ovs_interfaceid": "21d54204-0541-4b46-9c4b-13a826123e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Converting VIF {"id": "21d54204-0541-4b46-9c4b-13a826123e4a", "address": "fa:16:3e:30:3b:71", "network": {"id": "07adb718-1379-4f03-80cb-84fb5ea2f086", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1044212390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c3e67aaa7e94f2ab8d700776bc203e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d54204-05", "ovs_interfaceid": "21d54204-0541-4b46-9c4b-13a826123e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3b:71,bridge_name='br-int',has_traffic_filtering=True,id=21d54204-0541-4b46-9c4b-13a826123e4a,network=Network(07adb718-1379-4f03-80cb-84fb5ea2f086),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d54204-05') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG os_vif [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3b:71,bridge_name='br-int',has_traffic_filtering=True,id=21d54204-0541-4b46-9c4b-13a826123e4a,network=Network(07adb718-1379-4f03-80cb-84fb5ea2f086),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d54204-05') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21d54204-05, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21d54204-05, col_values=(('external_ids', {'iface-id': '21d54204-0541-4b46-9c4b-13a826123e4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:3b:71', 'vm-uuid': '8d5e4107-7c28-4c75-aa0a-9e467f0536d6'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:40 user nova-compute[71312]: INFO os_vif [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3b:71,bridge_name='br-int',has_traffic_filtering=True,id=21d54204-0541-4b46-9c4b-13a826123e4a,network=Network(07adb718-1379-4f03-80cb-84fb5ea2f086),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d54204-05')
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] No VIF found with MAC fa:16:3e:30:3b:71, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:40 user nova-compute[71312]: INFO nova.compute.manager [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Terminating instance
Jul 25 10:03:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-628a3b16-6c3e-4cb3-b108-ce240a49bd99 req-d5019ad6-efa2-471b-a2aa-adc98cc4a9c0 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Updated VIF entry in instance network info cache for port 21d54204-0541-4b46-9c4b-13a826123e4a. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-628a3b16-6c3e-4cb3-b108-ce240a49bd99 req-d5019ad6-efa2-471b-a2aa-adc98cc4a9c0 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Updating instance_info_cache with network_info: [{"id": "21d54204-0541-4b46-9c4b-13a826123e4a", "address": "fa:16:3e:30:3b:71", "network": {"id": "07adb718-1379-4f03-80cb-84fb5ea2f086", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1044212390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c3e67aaa7e94f2ab8d700776bc203e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d54204-05", "ovs_interfaceid": "21d54204-0541-4b46-9c4b-13a826123e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-628a3b16-6c3e-4cb3-b108-ce240a49bd99 req-d5019ad6-efa2-471b-a2aa-adc98cc4a9c0 service nova] Releasing lock "refresh_cache-8d5e4107-7c28-4c75-aa0a-9e467f0536d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-1f0d80a3-4601-41eb-9a8b-2b26555ec315 req-729230b2-180c-45ae-8a89-79de92c5a617 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-unplugged-3dabfadb-6d85-4051-8795-2b23c225c72e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1f0d80a3-4601-41eb-9a8b-2b26555ec315 req-729230b2-180c-45ae-8a89-79de92c5a617 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1f0d80a3-4601-41eb-9a8b-2b26555ec315 req-729230b2-180c-45ae-8a89-79de92c5a617 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1f0d80a3-4601-41eb-9a8b-2b26555ec315 req-729230b2-180c-45ae-8a89-79de92c5a617 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-1f0d80a3-4601-41eb-9a8b-2b26555ec315 req-729230b2-180c-45ae-8a89-79de92c5a617 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-unplugged-3dabfadb-6d85-4051-8795-2b23c225c72e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-1f0d80a3-4601-41eb-9a8b-2b26555ec315 req-729230b2-180c-45ae-8a89-79de92c5a617 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-unplugged-3dabfadb-6d85-4051-8795-2b23c225c72e for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-de624ed1-3c32-4901-912f-5c9617588709 req-13441b03-4df3-4b03-8ae1-aec0b39746da service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-unplugged-468cbd00-2f81-4c6f-80c4-4561d2d57913 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-de624ed1-3c32-4901-912f-5c9617588709 req-13441b03-4df3-4b03-8ae1-aec0b39746da service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-de624ed1-3c32-4901-912f-5c9617588709 req-13441b03-4df3-4b03-8ae1-aec0b39746da service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-de624ed1-3c32-4901-912f-5c9617588709 req-13441b03-4df3-4b03-8ae1-aec0b39746da service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-de624ed1-3c32-4901-912f-5c9617588709 req-13441b03-4df3-4b03-8ae1-aec0b39746da service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-unplugged-468cbd00-2f81-4c6f-80c4-4561d2d57913 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-de624ed1-3c32-4901-912f-5c9617588709 req-13441b03-4df3-4b03-8ae1-aec0b39746da service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-unplugged-468cbd00-2f81-4c6f-80c4-4561d2d57913 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-unplugged-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-unplugged-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-unplugged-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:42 user nova-compute[71312]: WARNING nova.compute.manager [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 for instance with vm_state active and task_state deleting.
Jul 25 10:03:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-unplugged-10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-unplugged-10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-6f0fab07-01ac-4730-abb9-956addd2dabb req-a19e709c-80b1-4fb4-ae39-15ec15367109 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-unplugged-10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:42 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Instance destroyed successfully.
Jul 25 10:03:42 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lazy-loading 'resources' on Instance uuid 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:02:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "address": "fa:16:3e:4b:a2:8f", "network": {"id": "8c9da59c-8815-4721-baf9-4931ceb98e10", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1623323297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6bdd57-e2", "ovs_interfaceid": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "address": "fa:16:3e:4b:a2:8f", "network": {"id": "8c9da59c-8815-4721-baf9-4931ceb98e10", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1623323297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6bdd57-e2", "ovs_interfaceid": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:a2:8f,bridge_name='br-int',has_traffic_filtering=True,id=8e6bdd57-e2ac-4de4-bfb6-a2e511203f21,network=Network(8c9da59c-8815-4721-baf9-4931ceb98e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e6bdd57-e2') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG os_vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:a2:8f,bridge_name='br-int',has_traffic_filtering=True,id=8e6bdd57-e2ac-4de4-bfb6-a2e511203f21,network=Network(8c9da59c-8815-4721-baf9-4931ceb98e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e6bdd57-e2') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e6bdd57-e2, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: INFO os_vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:a2:8f,bridge_name='br-int',has_traffic_filtering=True,id=8e6bdd57-e2ac-4de4-bfb6-a2e511203f21,network=Network(8c9da59c-8815-4721-baf9-4931ceb98e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e6bdd57-e2')
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:02:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:33:82,bridge_name='br-int',has_traffic_filtering=True,id=3dabfadb-6d85-4051-8795-2b23c225c72e,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3dabfadb-6d') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:33:82,bridge_name='br-int',has_traffic_filtering=True,id=3dabfadb-6d85-4051-8795-2b23c225c72e,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3dabfadb-6d') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dabfadb-6d, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: INFO os_vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:33:82,bridge_name='br-int',has_traffic_filtering=True,id=3dabfadb-6d85-4051-8795-2b23c225c72e,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3dabfadb-6d')
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:02:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:52:60,bridge_name='br-int',has_traffic_filtering=True,id=10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap10cf2e6e-6c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:52:60,bridge_name='br-int',has_traffic_filtering=True,id=10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap10cf2e6e-6c') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10cf2e6e-6c, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: INFO os_vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:52:60,bridge_name='br-int',has_traffic_filtering=True,id=10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap10cf2e6e-6c')
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:02:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d2:04,bridge_name='br-int',has_traffic_filtering=True,id=ed410f46-787b-4200-8216-e8678856af7f,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped410f46-78') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d2:04,bridge_name='br-int',has_traffic_filtering=True,id=ed410f46-787b-4200-8216-e8678856af7f,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped410f46-78') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped410f46-78, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: INFO os_vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d2:04,bridge_name='br-int',has_traffic_filtering=True,id=ed410f46-787b-4200-8216-e8678856af7f,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped410f46-78')
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:02:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81060ccd-4ba6-4d40-b340-320cfa254f38", "address": "fa:16:3e:1b:2f:74", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81060ccd-4b", "ovs_interfaceid": "81060ccd-4ba6-4d40-b340-320cfa254f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "81060ccd-4ba6-4d40-b340-320cfa254f38", "address": "fa:16:3e:1b:2f:74", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81060ccd-4b", "ovs_interfaceid": "81060ccd-4ba6-4d40-b340-320cfa254f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2f:74,bridge_name='br-int',has_traffic_filtering=True,id=81060ccd-4ba6-4d40-b340-320cfa254f38,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81060ccd-4b') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2f:74,bridge_name='br-int',has_traffic_filtering=True,id=81060ccd-4ba6-4d40-b340-320cfa254f38,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81060ccd-4b') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81060ccd-4b, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: INFO os_vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2f:74,bridge_name='br-int',has_traffic_filtering=True,id=81060ccd-4ba6-4d40-b340-320cfa254f38,network=Network(ba8e6165-e483-458d-b47a-f5756d524796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81060ccd-4b')
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:02:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "address": "fa:16:3e:27:68:29", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468cbd00-2f", "ovs_interfaceid": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "address": "fa:16:3e:27:68:29", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468cbd00-2f", "ovs_interfaceid": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:68:29,bridge_name='br-int',has_traffic_filtering=True,id=468cbd00-2f81-4c6f-80c4-4561d2d57913,network=Network(8aaee903-2925-4f3e-966e-ae4afb3db554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468cbd00-2f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:68:29,bridge_name='br-int',has_traffic_filtering=True,id=468cbd00-2f81-4c6f-80c4-4561d2d57913,network=Network(8aaee903-2925-4f3e-966e-ae4afb3db554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468cbd00-2f') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap468cbd00-2f, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: INFO os_vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:68:29,bridge_name='br-int',has_traffic_filtering=True,id=468cbd00-2f81-4c6f-80c4-4561d2d57913,network=Network(8aaee903-2925-4f3e-966e-ae4afb3db554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468cbd00-2f')
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-265559078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-265559078',id=11,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiy3w9Igl6msseoaHFQL/ozQimGyr0qbGM+JHgHiijY+OIacGb/2wJZXWHCejaHXeavD3ZWL1D1ZvP3jdK9MHHXY/DIBaejHNZILPPzFBIXpJtvDeUsT46oWmn+Hcy7ug==',key_name='tempest-keypair-627871328',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:02:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='171fe858b48046a3817ece863e1ce913',ramdisk_id='',reservation_id='r-09pcc2xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-886816588',owner_user_name='tempest-TaggedBootDevicesTest-886816588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf17e9e8609440318fc8061235db7bae',uuid=7e67c6e4-1c08-4d49-8537-5d0c9899c9bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "address": "fa:16:3e:20:5d:92", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90ea84d-dc", "ovs_interfaceid": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converting VIF {"id": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "address": "fa:16:3e:20:5d:92", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90ea84d-dc", "ovs_interfaceid": "e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:5d:92,bridge_name='br-int',has_traffic_filtering=True,id=e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc,network=Network(8aaee903-2925-4f3e-966e-ae4afb3db554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90ea84d-dc') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:5d:92,bridge_name='br-int',has_traffic_filtering=True,id=e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc,network=Network(8aaee903-2925-4f3e-966e-ae4afb3db554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90ea84d-dc') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape90ea84d-dc, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:43 user nova-compute[71312]: INFO os_vif [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:5d:92,bridge_name='br-int',has_traffic_filtering=True,id=e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc,network=Network(8aaee903-2925-4f3e-966e-ae4afb3db554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90ea84d-dc')
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSbaYUsD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:03:43 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c7abe8-c364-4488-ba68-90714b5ffcd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:03:43 user nova-compute[71312]: No targets found.
Jul 25 10:03:43 user nova-compute[71312]: iSNS:
Jul 25 10:03:43 user nova-compute[71312]: No targets found.
Jul 25 10:03:43 user nova-compute[71312]: STATIC:
Jul 25 10:03:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec
Jul 25 10:03:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496
Jul 25 10:03:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343
Jul 25 10:03:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9
Jul 25 10:03:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:03:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:43 user nova-compute[71312]: FIRMWARE:
Jul 25 10:03:43 user nova-compute[71312]: No targets found.
Jul 25 10:03:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:03:43 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:03:43 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cd6753-e61b-4cb8-9203-1d18eff07300]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f97e72-dd39-4714-b802-7a4e29e58ee7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:03:43 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:43 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:43 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:43 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 (non-flash)
Jul 25 10:03:43 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:43 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:43 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:43 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a87831c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edbf8a9-f328-48f9-97e4-a742dd1993b7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1029f9d2-5f4a-4ca8-b6ed-42e18918a246]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[97acc7b6-dfb0-43e9-aa13-fb7f80114b53]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d83e40-7d74-4f5b-a87b-30d6d1a3c5fa]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae22e988-ab64-45a2-9dc8-01f4be7875fa]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[534364b0-1e73-42b3-9850-6a9cdda94d14]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496, portal: 172.16.0.220,3260]
Jul 25 10:03:43 user nova-compute[71312]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496, portal: 172.16.0.220,3260] successful.
Jul 25 10:03:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:111f427e-b751-49ca-b2f5-56e733cfd496 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[37881015-cf61-4d9f-b5b4-828f3ff826a3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] <== disconnect_volume: return (332ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WIUOFDpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:03:43 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-3dabfadb-6d85-4051-8795-2b23c225c72e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-3dabfadb-6d85-4051-8795-2b23c225c72e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:43 user nova-compute[71312]: WARNING nova.compute.manager [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-3dabfadb-6d85-4051-8795-2b23c225c72e for instance with vm_state active and task_state deleting.
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-unplugged-81060ccd-4ba6-4d40-b340-320cfa254f38 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-unplugged-81060ccd-4ba6-4d40-b340-320cfa254f38 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-unplugged-81060ccd-4ba6-4d40-b340-320cfa254f38 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-81060ccd-4ba6-4d40-b340-320cfa254f38 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-81060ccd-4ba6-4d40-b340-320cfa254f38 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:43 user nova-compute[71312]: WARNING nova.compute.manager [req-b560a3a3-e950-434d-a567-2471800fec60 req-5b3c2050-43f1-40b3-ab0b-399c1a7ef34b service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-81060ccd-4ba6-4d40-b340-320cfa254f38 for instance with vm_state active and task_state deleting.
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e12715-5d55-479c-b04e-e490f68fdbf2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:03:43 user nova-compute[71312]: No targets found.
Jul 25 10:03:43 user nova-compute[71312]: iSNS:
Jul 25 10:03:43 user nova-compute[71312]: No targets found.
Jul 25 10:03:43 user nova-compute[71312]: STATIC:
Jul 25 10:03:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec
Jul 25 10:03:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343
Jul 25 10:03:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9
Jul 25 10:03:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:03:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:43 user nova-compute[71312]: FIRMWARE:
Jul 25 10:03:43 user nova-compute[71312]: No targets found.
Jul 25 10:03:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:03:43 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:03:43 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ce542e-b438-4bdc-8535-ea766e4d4d57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-468cbd00-2f81-4c6f-80c4-4561d2d57913 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-468cbd00-2f81-4c6f-80c4-4561d2d57913 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:43 user nova-compute[71312]: WARNING nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-468cbd00-2f81-4c6f-80c4-4561d2d57913 for instance with vm_state active and task_state deleting.
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-unplugged-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-unplugged-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-unplugged-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:43 user nova-compute[71312]: WARNING nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc for instance with vm_state active and task_state deleting.
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Received event network-vif-plugged-21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] No waiting events found dispatching network-vif-plugged-21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:43 user nova-compute[71312]: WARNING nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Received unexpected event network-vif-plugged-21d54204-0541-4b46-9c4b-13a826123e4a for instance with vm_state building and task_state spawning.
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Received event network-vif-plugged-21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] No waiting events found dispatching network-vif-plugged-21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:43 user nova-compute[71312]: WARNING nova.compute.manager [req-dc3b3211-fc3b-43ed-ba4d-f0c922424938 req-405721f5-97cd-4fed-b3a1-551b1480d64c service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Received unexpected event network-vif-plugged-21d54204-0541-4b46-9c4b-13a826123e4a for instance with vm_state building and task_state spawning.
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f9bbd1-fc29-45f1-8a08-eb8c16375d81]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:43 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:43 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:43 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec (non-flash)
Jul 25 10:03:43 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:43 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:43 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a864e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:03:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[48871816-c413-440a-a883-7232308bca65]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[05543f7b-1987-4eae-b2ec-9331b9605704]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1286f87f-a699-4906-8dab-7809b3175686]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[026be601-637f-4d3c-baf3-fe6184bf25e0]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e4c1b1-8192-4caf-b0a3-81ccb5a2a710]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f21928-0da1-4d14-8d1c-953b3f2643dd]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec, portal: 172.16.0.220,3260]
Jul 25 10:03:44 user nova-compute[71312]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec, portal: 172.16.0.220,3260] successful.
Jul 25 10:03:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:44 user nova-compute[71312]: WARNING nova.compute.manager [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d for instance with vm_state active and task_state deleting.
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-unplugged-ed410f46-787b-4200-8216-e8678856af7f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-unplugged-ed410f46-787b-4200-8216-e8678856af7f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-unplugged-ed410f46-787b-4200-8216-e8678856af7f for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-plugged-ed410f46-787b-4200-8216-e8678856af7f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] Acquiring lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] No waiting events found dispatching network-vif-plugged-ed410f46-787b-4200-8216-e8678856af7f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:44 user nova-compute[71312]: WARNING nova.compute.manager [req-381be964-bc04-416e-92e5-3ea6f709798c req-84527f67-ce34-47c3-8aca-debfb1bd4896 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received unexpected event network-vif-plugged-ed410f46-787b-4200-8216-e8678856af7f for instance with vm_state active and task_state deleting.
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de850d0b-017d-48b5-b6c5-fb47e57d47ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[42783735-cc2a-489c-abdf-661764e0783e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] <== disconnect_volume: return (344ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyoYkncQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:03:44 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a8ae6b-ef8c-49b7-935f-4ce07e0271ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:03:44 user nova-compute[71312]: No targets found.
Jul 25 10:03:44 user nova-compute[71312]: iSNS:
Jul 25 10:03:44 user nova-compute[71312]: No targets found.
Jul 25 10:03:44 user nova-compute[71312]: STATIC:
Jul 25 10:03:44 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343
Jul 25 10:03:44 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:44 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:44 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9
Jul 25 10:03:44 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:44 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:44 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:03:44 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:03:44 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:03:44 user nova-compute[71312]: FIRMWARE:
Jul 25 10:03:44 user nova-compute[71312]: No targets found.
Jul 25 10:03:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:03:44 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:03:44 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[869a604c-1114-49d5-a03e-09af7c985358]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[13720001-5546-45b1-9048-7ac44b49671c]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:44 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:44 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 (non-flash)
Jul 25 10:03:44 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:44 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a864c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e95a81d-c267-4fc3-abfe-6c1f557b9b76]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcc417f-f212-468d-95d6-6b32b6a92756]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fae7be6-3991-47c5-84df-8c26de18a59f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbbc382-7125-4429-9348-0cd33cf230c7]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0dd1ed-877d-4fa8-b811-43ce3e5bdd3e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cb7108-070c-4d56-a2db-e1d49593f726]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343, portal: 172.16.0.220,3260]
Jul 25 10:03:44 user nova-compute[71312]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343, portal: 172.16.0.220,3260] successful.
Jul 25 10:03:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45999e73-d8f4-4c0d-9ea5-9d77e0e61343 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d26a171-e348-4264-aeec-f3289f19c46b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] <== disconnect_volume: return (320ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:03:44 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Deleting instance files /opt/stack/data/nova/instances/7e67c6e4-1c08-4d49-8537-5d0c9899c9bd_del
Jul 25 10:03:44 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Deletion of /opt/stack/data/nova/instances/7e67c6e4-1c08-4d49-8537-5d0c9899c9bd_del complete
Jul 25 10:03:44 user nova-compute[71312]: INFO nova.compute.manager [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Took 3.86 seconds to destroy the instance on the hypervisor.
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279424.6949325, 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:03:44 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] VM Resumed (Lifecycle Event)
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:03:44 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Instance spawned successfully.
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:03:44 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279424.6965754, 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:03:44 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] VM Started (Lifecycle Event)
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:03:44 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:03:44 user nova-compute[71312]: INFO nova.compute.manager [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Took 7.88 seconds to spawn the instance on the hypervisor.
Jul 25 10:03:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:03:44 user nova-compute[71312]: INFO nova.compute.manager [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Took 8.74 seconds to build instance.
Jul 25 10:03:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a6895dc8-aec6-4aa5-bd2d-0351f8f2476c tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.838s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:03:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Creating image(s)
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Ensure instance console log exists: /opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Start _get_guest_xml network_info=[{"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '3e62b5ad-a285-4c19-a715-a8ae5324492f', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLcksZOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8216c52e-c0a7-42b1-9766-7bcffa376b28', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe867eea-e811-4400-93ea-32e8399134b6', 'serial': 'fe867eea-e811-4400-93ea-32e8399134b6'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:03:45 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:03:45 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLcksZOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:03:45 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:03:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:03:45 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:03:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:03:45 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b120e4fb-35b6-4762-8123-2428f0ca3a82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:03:45 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bbd791-2b8e-4be7-a4b6-4ac9eb6f20de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6] added
Jul 25 10:03:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[371d95f4-ab55-4d6e-a30c-5f44cba01f63]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4749e2c-ae17-401b-af57-28432fd97f64]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GLcksZOh {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GLcksZOh" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0811b5a8-d599-4515-8014-2aec24f3d273]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GLcksZOh'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3635f3ff-840d-4457-a578-219e3b91d139]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a17578c-5b1d-4681-9b13-8260e75db3af]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:45 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:45 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:03:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c81d91-f66f-4fb8-8e02-24bddf74e989]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6, portal: 172.16.0.220,3260]
Jul 25 10:03:46 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6, portal: 172.16.0.220,3260] successful.
Jul 25 10:03:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f068b5-f693-4b7a-a635-9a9688eae5c7]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0aaaee-a415-458a-b999-a4b27ff6dcb0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:03:46 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:46 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:03:46 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:03:46 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:03:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6707c8-61bb-4b97-a67a-487e2e9df02a]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLcksZOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-af411981-2744-42f2-bb6d-6a9ec204fc18 req-2f488d2e-80ad-4de4-8dd2-2f8a9661be46 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-deleted-e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:46 user nova-compute[71312]: INFO nova.compute.manager [req-af411981-2744-42f2-bb6d-6a9ec204fc18 req-2f488d2e-80ad-4de4-8dd2-2f8a9661be46 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Neutron deleted interface e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc; detaching it from the instance and deleting it from the info cache
Jul 25 10:03:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-af411981-2744-42f2-bb6d-6a9ec204fc18 req-2f488d2e-80ad-4de4-8dd2-2f8a9661be46 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating instance_info_cache with network_info: [{"id": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "address": "fa:16:3e:4b:a2:8f", "network": {"id": "8c9da59c-8815-4721-baf9-4931ceb98e10", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1623323297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6bdd57-e2", "ovs_interfaceid": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81060ccd-4ba6-4d40-b340-320cfa254f38", "address": "fa:16:3e:1b:2f:74", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81060ccd-4b", "ovs_interfaceid": "81060ccd-4ba6-4d40-b340-320cfa254f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "address": "fa:16:3e:27:68:29", "network": {"id": "8aaee903-2925-4f3e-966e-ae4afb3db554", "bridge": "br-int", "label": "tempest-device-tagging-net2-26024414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468cbd00-2f", "ovs_interfaceid": "468cbd00-2f81-4c6f-80c4-4561d2d57913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-af411981-2744-42f2-bb6d-6a9ec204fc18 req-2f488d2e-80ad-4de4-8dd2-2f8a9661be46 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Detach interface failed, port_id=e90ea84d-dcac-4c4d-845a-9fcc80d3dcbc, reason: Instance 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:03:46 user nova-compute[71312]: INFO nova.compute.claims [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Claim successful on node user
Jul 25 10:03:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23865313835653631', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865313835653631', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1051551930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1051551930',id=13,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b14fcd7739f41eabc9e7120f5b58a08',ramdisk_id='',reservation_id='r-nro7mwcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-13369838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:03:32Z,user_data=None,user_id='96d25383d4b6448da2d30479a26bfa0f',uuid=8216c52e-c0a7-42b1-9766-7bcffa376b28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converting VIF {"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=3fa3349e-fba2-4bba-a1cb-1ef17e40f35a,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa3349e-fb') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.objects.instance [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'pci_devices' on Instance uuid 8216c52e-c0a7-42b1-9766-7bcffa376b28 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:03:47 user nova-compute[71312]:   <uuid>8216c52e-c0a7-42b1-9766-7bcffa376b28</uuid>
Jul 25 10:03:47 user nova-compute[71312]:   <name>instance-0000000d</name>
Jul 25 10:03:47 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:03:47 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:03:47 user nova-compute[71312]:   <metadata>
Jul 25 10:03:47 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:03:47 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:03:47 user nova-compute[71312]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1051551930</nova:name>
Jul 25 10:03:47 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:03:45</nova:creationTime>
Jul 25 10:03:47 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:03:47 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:03:47 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:03:47 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:03:47 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:03:47 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:03:47 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:03:47 user nova-compute[71312]:       <nova:owner>
Jul 25 10:03:47 user nova-compute[71312]:         <nova:user uuid="96d25383d4b6448da2d30479a26bfa0f">tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member</nova:user>
Jul 25 10:03:47 user nova-compute[71312]:         <nova:project uuid="0b14fcd7739f41eabc9e7120f5b58a08">tempest-ServerBootFromVolumeStableRescueTest-13369838</nova:project>
Jul 25 10:03:47 user nova-compute[71312]:       </nova:owner>
Jul 25 10:03:47 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:03:47 user nova-compute[71312]:       <nova:ports>
Jul 25 10:03:47 user nova-compute[71312]:         <nova:port uuid="3fa3349e-fba2-4bba-a1cb-1ef17e40f35a">
Jul 25 10:03:47 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 10:03:47 user nova-compute[71312]:         </nova:port>
Jul 25 10:03:47 user nova-compute[71312]:       </nova:ports>
Jul 25 10:03:47 user nova-compute[71312]:     </nova:instance>
Jul 25 10:03:47 user nova-compute[71312]:   </metadata>
Jul 25 10:03:47 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:03:47 user nova-compute[71312]:     <system>
Jul 25 10:03:47 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:03:47 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:03:47 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:03:47 user nova-compute[71312]:       <entry name="serial">8216c52e-c0a7-42b1-9766-7bcffa376b28</entry>
Jul 25 10:03:47 user nova-compute[71312]:       <entry name="uuid">8216c52e-c0a7-42b1-9766-7bcffa376b28</entry>
Jul 25 10:03:47 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:03:47 user nova-compute[71312]:     </system>
Jul 25 10:03:47 user nova-compute[71312]:   </sysinfo>
Jul 25 10:03:47 user nova-compute[71312]:   <os>
Jul 25 10:03:47 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:03:47 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:03:47 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:03:47 user nova-compute[71312]:   </os>
Jul 25 10:03:47 user nova-compute[71312]:   <features>
Jul 25 10:03:47 user nova-compute[71312]:     <acpi/>
Jul 25 10:03:47 user nova-compute[71312]:     <apic/>
Jul 25 10:03:47 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:03:47 user nova-compute[71312]:   </features>
Jul 25 10:03:47 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:03:47 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:03:47 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:03:47 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:03:47 user nova-compute[71312]:   </clock>
Jul 25 10:03:47 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:03:47 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:03:47 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:03:47 user nova-compute[71312]:   </cpu>
Jul 25 10:03:47 user nova-compute[71312]:   <devices>
Jul 25 10:03:47 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:03:47 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:03:47 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Jul 25 10:03:47 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:03:47 user nova-compute[71312]:       <serial>fe867eea-e811-4400-93ea-32e8399134b6</serial>
Jul 25 10:03:47 user nova-compute[71312]:     </disk>
Jul 25 10:03:47 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:03:47 user nova-compute[71312]:       <mac address="fa:16:3e:20:f2:32"/>
Jul 25 10:03:47 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:03:47 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:03:47 user nova-compute[71312]:       <target dev="tap3fa3349e-fb"/>
Jul 25 10:03:47 user nova-compute[71312]:     </interface>
Jul 25 10:03:47 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:03:47 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/console.log" append="off"/>
Jul 25 10:03:47 user nova-compute[71312]:     </serial>
Jul 25 10:03:47 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:03:47 user nova-compute[71312]:     <video>
Jul 25 10:03:47 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:03:47 user nova-compute[71312]:     </video>
Jul 25 10:03:47 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:03:47 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:03:47 user nova-compute[71312]:     </rng>
Jul 25 10:03:47 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:03:47 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:03:47 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:03:47 user nova-compute[71312]:     </memballoon>
Jul 25 10:03:47 user nova-compute[71312]:   </devices>
Jul 25 10:03:47 user nova-compute[71312]: </domain>
Jul 25 10:03:47 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1051551930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1051551930',id=13,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b14fcd7739f41eabc9e7120f5b58a08',ramdisk_id='',reservation_id='r-nro7mwcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-13369838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:03:32Z,user_data=None,user_id='96d25383d4b6448da2d30479a26bfa0f',uuid=8216c52e-c0a7-42b1-9766-7bcffa376b28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converting VIF {"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=3fa3349e-fba2-4bba-a1cb-1ef17e40f35a,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa3349e-fb') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG os_vif [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=3fa3349e-fba2-4bba-a1cb-1ef17e40f35a,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa3349e-fb') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fa3349e-fb, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3fa3349e-fb, col_values=(('external_ids', {'iface-id': '3fa3349e-fba2-4bba-a1cb-1ef17e40f35a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:f2:32', 'vm-uuid': '8216c52e-c0a7-42b1-9766-7bcffa376b28'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:47 user nova-compute[71312]: INFO os_vif [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=3fa3349e-fba2-4bba-a1cb-1ef17e40f35a,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa3349e-fb')
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] No VIF found with MAC fa:16:3e:20:f2:32, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:03:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.policy [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c34765a32ae4f2ba338aec6b2240683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95726128af5243deabbbdcd68c5ccdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:03:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Creating image(s)
Jul 25 10:03:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "/opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "/opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk 1073741824" returned: 0 in 0.052s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Successfully created port: 100f3561-4981-45d9-add5-394b7e0be5bc {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.177s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Cannot resize image /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lazy-loading 'migration_context' on Instance uuid bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Ensure instance console log exists: /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-666cbf80-6153-4250-bd51-0405c426ebb3 req-ce55e159-0584-4a9f-aaaf-790b643e2576 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-deleted-468cbd00-2f81-4c6f-80c4-4561d2d57913 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:48 user nova-compute[71312]: INFO nova.compute.manager [req-666cbf80-6153-4250-bd51-0405c426ebb3 req-ce55e159-0584-4a9f-aaaf-790b643e2576 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Neutron deleted interface 468cbd00-2f81-4c6f-80c4-4561d2d57913; detaching it from the instance and deleting it from the info cache
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.network.neutron [req-666cbf80-6153-4250-bd51-0405c426ebb3 req-ce55e159-0584-4a9f-aaaf-790b643e2576 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating instance_info_cache with network_info: [{"id": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "address": "fa:16:3e:4b:a2:8f", "network": {"id": "8c9da59c-8815-4721-baf9-4931ceb98e10", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1623323297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6bdd57-e2", "ovs_interfaceid": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81060ccd-4ba6-4d40-b340-320cfa254f38", "address": "fa:16:3e:1b:2f:74", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81060ccd-4b", "ovs_interfaceid": "81060ccd-4ba6-4d40-b340-320cfa254f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-666cbf80-6153-4250-bd51-0405c426ebb3 req-ce55e159-0584-4a9f-aaaf-790b643e2576 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Detach interface failed, port_id=468cbd00-2f81-4c6f-80c4-4561d2d57913, reason: Instance 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-666cbf80-6153-4250-bd51-0405c426ebb3 req-ce55e159-0584-4a9f-aaaf-790b643e2576 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-deleted-81060ccd-4ba6-4d40-b340-320cfa254f38 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:48 user nova-compute[71312]: INFO nova.compute.manager [req-666cbf80-6153-4250-bd51-0405c426ebb3 req-ce55e159-0584-4a9f-aaaf-790b643e2576 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Neutron deleted interface 81060ccd-4ba6-4d40-b340-320cfa254f38; detaching it from the instance and deleting it from the info cache
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.network.neutron [req-666cbf80-6153-4250-bd51-0405c426ebb3 req-ce55e159-0584-4a9f-aaaf-790b643e2576 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating instance_info_cache with network_info: [{"id": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "address": "fa:16:3e:4b:a2:8f", "network": {"id": "8c9da59c-8815-4721-baf9-4931ceb98e10", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1623323297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e6bdd57-e2", "ovs_interfaceid": "8e6bdd57-e2ac-4de4-bfb6-a2e511203f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-666cbf80-6153-4250-bd51-0405c426ebb3 req-ce55e159-0584-4a9f-aaaf-790b643e2576 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Detach interface failed, port_id=81060ccd-4ba6-4d40-b340-320cfa254f38, reason: Instance 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-666cbf80-6153-4250-bd51-0405c426ebb3 req-ce55e159-0584-4a9f-aaaf-790b643e2576 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-deleted-8e6bdd57-e2ac-4de4-bfb6-a2e511203f21 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:48 user nova-compute[71312]: INFO nova.compute.manager [req-666cbf80-6153-4250-bd51-0405c426ebb3 req-ce55e159-0584-4a9f-aaaf-790b643e2576 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Neutron deleted interface 8e6bdd57-e2ac-4de4-bfb6-a2e511203f21; detaching it from the instance and deleting it from the info cache
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.network.neutron [req-666cbf80-6153-4250-bd51-0405c426ebb3 req-ce55e159-0584-4a9f-aaaf-790b643e2576 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating instance_info_cache with network_info: [{"id": "3dabfadb-6d85-4051-8795-2b23c225c72e", "address": "fa:16:3e:6d:33:82", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dabfadb-6d", "ovs_interfaceid": "3dabfadb-6d85-4051-8795-2b23c225c72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "address": "fa:16:3e:c1:52:60", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cf2e6e-6c", "ovs_interfaceid": "10cf2e6e-6c52-4cf0-aaaf-9ebba4606a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed410f46-787b-4200-8216-e8678856af7f", "address": "fa:16:3e:8c:d2:04", "network": {"id": "ba8e6165-e483-458d-b47a-f5756d524796", "bridge": "br-int", "label": "tempest-device-tagging-net1-1060365237", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "171fe858b48046a3817ece863e1ce913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped410f46-78", "ovs_interfaceid": "ed410f46-787b-4200-8216-e8678856af7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-666cbf80-6153-4250-bd51-0405c426ebb3 req-ce55e159-0584-4a9f-aaaf-790b643e2576 service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Detach interface failed, port_id=8e6bdd57-e2ac-4de4-bfb6-a2e511203f21, reason: Instance 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:49 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Took 4.40 seconds to deallocate network for instance.
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Successfully updated port: 100f3561-4981-45d9-add5-394b7e0be5bc {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "refresh_cache-bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquired lock "refresh_cache-bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-a9a14288-bb6b-477d-b284-f05e2896b080 req-74ae3d77-47e0-483c-919b-1b1bcd427204 service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Received event network-changed-100f3561-4981-45d9-add5-394b7e0be5bc {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-a9a14288-bb6b-477d-b284-f05e2896b080 req-74ae3d77-47e0-483c-919b-1b1bcd427204 service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Refreshing instance network info cache due to event network-changed-100f3561-4981-45d9-add5-394b7e0be5bc. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a9a14288-bb6b-477d-b284-f05e2896b080 req-74ae3d77-47e0-483c-919b-1b1bcd427204 service nova] Acquiring lock "refresh_cache-bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Updating instance_info_cache with network_info: [{"id": "100f3561-4981-45d9-add5-394b7e0be5bc", "address": "fa:16:3e:99:20:26", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100f3561-49", "ovs_interfaceid": "100f3561-4981-45d9-add5-394b7e0be5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Releasing lock "refresh_cache-bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Instance network_info: |[{"id": "100f3561-4981-45d9-add5-394b7e0be5bc", "address": "fa:16:3e:99:20:26", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100f3561-49", "ovs_interfaceid": "100f3561-4981-45d9-add5-394b7e0be5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a9a14288-bb6b-477d-b284-f05e2896b080 req-74ae3d77-47e0-483c-919b-1b1bcd427204 service nova] Acquired lock "refresh_cache-bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-a9a14288-bb6b-477d-b284-f05e2896b080 req-74ae3d77-47e0-483c-919b-1b1bcd427204 service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Refreshing network info cache for port 100f3561-4981-45d9-add5-394b7e0be5bc {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Start _get_guest_xml network_info=[{"id": "100f3561-4981-45d9-add5-394b7e0be5bc", "address": "fa:16:3e:99:20:26", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100f3561-49", "ovs_interfaceid": "100f3561-4981-45d9-add5-394b7e0be5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:03:49 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:03:49 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-402470639',display_name='tempest-VolumesAdminNegativeTest-server-402470639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-402470639',id=15,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95726128af5243deabbbdcd68c5ccdcb',ramdisk_id='',reservation_id='r-hc6uxk0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-692637044',owner_user_name='tempest-VolumesAdminNegativeTest-692637044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:03:48Z,user_data=None,user_id='2c34765a32ae4f2ba338aec6b2240683',uuid=bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "100f3561-4981-45d9-add5-394b7e0be5bc", "address": "fa:16:3e:99:20:26", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100f3561-49", "ovs_interfaceid": "100f3561-4981-45d9-add5-394b7e0be5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Converting VIF {"id": "100f3561-4981-45d9-add5-394b7e0be5bc", "address": "fa:16:3e:99:20:26", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100f3561-49", "ovs_interfaceid": "100f3561-4981-45d9-add5-394b7e0be5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:20:26,bridge_name='br-int',has_traffic_filtering=True,id=100f3561-4981-45d9-add5-394b7e0be5bc,network=Network(b77e8256-729d-45ef-9624-d10cebfb647a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100f3561-49') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lazy-loading 'pci_devices' on Instance uuid bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:03:49 user nova-compute[71312]:   <uuid>bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a</uuid>
Jul 25 10:03:49 user nova-compute[71312]:   <name>instance-0000000f</name>
Jul 25 10:03:49 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:03:49 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:03:49 user nova-compute[71312]:   <metadata>
Jul 25 10:03:49 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:03:49 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:03:49 user nova-compute[71312]:       <nova:name>tempest-VolumesAdminNegativeTest-server-402470639</nova:name>
Jul 25 10:03:49 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:03:49</nova:creationTime>
Jul 25 10:03:49 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:03:49 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:03:49 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:03:49 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:03:49 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:03:49 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:03:49 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:03:49 user nova-compute[71312]:       <nova:owner>
Jul 25 10:03:49 user nova-compute[71312]:         <nova:user uuid="2c34765a32ae4f2ba338aec6b2240683">tempest-VolumesAdminNegativeTest-692637044-project-member</nova:user>
Jul 25 10:03:49 user nova-compute[71312]:         <nova:project uuid="95726128af5243deabbbdcd68c5ccdcb">tempest-VolumesAdminNegativeTest-692637044</nova:project>
Jul 25 10:03:49 user nova-compute[71312]:       </nova:owner>
Jul 25 10:03:49 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:03:49 user nova-compute[71312]:       <nova:ports>
Jul 25 10:03:49 user nova-compute[71312]:         <nova:port uuid="100f3561-4981-45d9-add5-394b7e0be5bc">
Jul 25 10:03:49 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 10:03:49 user nova-compute[71312]:         </nova:port>
Jul 25 10:03:49 user nova-compute[71312]:       </nova:ports>
Jul 25 10:03:49 user nova-compute[71312]:     </nova:instance>
Jul 25 10:03:49 user nova-compute[71312]:   </metadata>
Jul 25 10:03:49 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:03:49 user nova-compute[71312]:     <system>
Jul 25 10:03:49 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:03:49 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:03:49 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:03:49 user nova-compute[71312]:       <entry name="serial">bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a</entry>
Jul 25 10:03:49 user nova-compute[71312]:       <entry name="uuid">bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a</entry>
Jul 25 10:03:49 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:03:49 user nova-compute[71312]:     </system>
Jul 25 10:03:49 user nova-compute[71312]:   </sysinfo>
Jul 25 10:03:49 user nova-compute[71312]:   <os>
Jul 25 10:03:49 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:03:49 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:03:49 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:03:49 user nova-compute[71312]:   </os>
Jul 25 10:03:49 user nova-compute[71312]:   <features>
Jul 25 10:03:49 user nova-compute[71312]:     <acpi/>
Jul 25 10:03:49 user nova-compute[71312]:     <apic/>
Jul 25 10:03:49 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:03:49 user nova-compute[71312]:   </features>
Jul 25 10:03:49 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:03:49 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:03:49 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:03:49 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:03:49 user nova-compute[71312]:   </clock>
Jul 25 10:03:49 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:03:49 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:03:49 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:03:49 user nova-compute[71312]:   </cpu>
Jul 25 10:03:49 user nova-compute[71312]:   <devices>
Jul 25 10:03:49 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:03:49 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:03:49 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk"/>
Jul 25 10:03:49 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:03:49 user nova-compute[71312]:     </disk>
Jul 25 10:03:49 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:03:49 user nova-compute[71312]:       <mac address="fa:16:3e:99:20:26"/>
Jul 25 10:03:49 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:03:49 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:03:49 user nova-compute[71312]:       <target dev="tap100f3561-49"/>
Jul 25 10:03:49 user nova-compute[71312]:     </interface>
Jul 25 10:03:49 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:03:49 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/console.log" append="off"/>
Jul 25 10:03:49 user nova-compute[71312]:     </serial>
Jul 25 10:03:49 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:03:49 user nova-compute[71312]:     <video>
Jul 25 10:03:49 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:03:49 user nova-compute[71312]:     </video>
Jul 25 10:03:49 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:03:49 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:03:49 user nova-compute[71312]:     </rng>
Jul 25 10:03:49 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:03:49 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:03:49 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:03:49 user nova-compute[71312]:     </memballoon>
Jul 25 10:03:49 user nova-compute[71312]:   </devices>
Jul 25 10:03:49 user nova-compute[71312]: </domain>
Jul 25 10:03:49 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-402470639',display_name='tempest-VolumesAdminNegativeTest-server-402470639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-402470639',id=15,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95726128af5243deabbbdcd68c5ccdcb',ramdisk_id='',reservation_id='r-hc6uxk0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-692637044',owner_user_name='tempest-VolumesAdminNegativeTest-692637044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:03:48Z,user_data=None,user_id='2c34765a32ae4f2ba338aec6b2240683',uuid=bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "100f3561-4981-45d9-add5-394b7e0be5bc", "address": "fa:16:3e:99:20:26", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100f3561-49", "ovs_interfaceid": "100f3561-4981-45d9-add5-394b7e0be5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Converting VIF {"id": "100f3561-4981-45d9-add5-394b7e0be5bc", "address": "fa:16:3e:99:20:26", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100f3561-49", "ovs_interfaceid": "100f3561-4981-45d9-add5-394b7e0be5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:20:26,bridge_name='br-int',has_traffic_filtering=True,id=100f3561-4981-45d9-add5-394b7e0be5bc,network=Network(b77e8256-729d-45ef-9624-d10cebfb647a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100f3561-49') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG os_vif [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:20:26,bridge_name='br-int',has_traffic_filtering=True,id=100f3561-4981-45d9-add5-394b7e0be5bc,network=Network(b77e8256-729d-45ef-9624-d10cebfb647a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100f3561-49') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap100f3561-49, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap100f3561-49, col_values=(('external_ids', {'iface-id': '100f3561-4981-45d9-add5-394b7e0be5bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:20:26', 'vm-uuid': 'bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:49 user nova-compute[71312]: INFO os_vif [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:20:26,bridge_name='br-int',has_traffic_filtering=True,id=100f3561-4981-45d9-add5-394b7e0be5bc,network=Network(b77e8256-729d-45ef-9624-d10cebfb647a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100f3561-49')
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] No VIF found with MAC fa:16:3e:99:20:26, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-a9a14288-bb6b-477d-b284-f05e2896b080 req-74ae3d77-47e0-483c-919b-1b1bcd427204 service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Updated VIF entry in instance network info cache for port 100f3561-4981-45d9-add5-394b7e0be5bc. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:03:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-a9a14288-bb6b-477d-b284-f05e2896b080 req-74ae3d77-47e0-483c-919b-1b1bcd427204 service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Updating instance_info_cache with network_info: [{"id": "100f3561-4981-45d9-add5-394b7e0be5bc", "address": "fa:16:3e:99:20:26", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100f3561-49", "ovs_interfaceid": "100f3561-4981-45d9-add5-394b7e0be5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:03:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a9a14288-bb6b-477d-b284-f05e2896b080 req-74ae3d77-47e0-483c-919b-1b1bcd427204 service nova] Releasing lock "refresh_cache-bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:03:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-f3ba9afb-11ad-45f9-90a1-1a0657ba1ba5 req-9a6a26da-ff7a-4107-820d-e352c962870f service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3ba9afb-11ad-45f9-90a1-1a0657ba1ba5 req-9a6a26da-ff7a-4107-820d-e352c962870f service nova] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3ba9afb-11ad-45f9-90a1-1a0657ba1ba5 req-9a6a26da-ff7a-4107-820d-e352c962870f service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3ba9afb-11ad-45f9-90a1-1a0657ba1ba5 req-9a6a26da-ff7a-4107-820d-e352c962870f service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-f3ba9afb-11ad-45f9-90a1-1a0657ba1ba5 req-9a6a26da-ff7a-4107-820d-e352c962870f service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] No waiting events found dispatching network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:50 user nova-compute[71312]: WARNING nova.compute.manager [req-f3ba9afb-11ad-45f9-90a1-1a0657ba1ba5 req-9a6a26da-ff7a-4107-820d-e352c962870f service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received unexpected event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a for instance with vm_state building and task_state spawning.
Jul 25 10:03:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-f3ba9afb-11ad-45f9-90a1-1a0657ba1ba5 req-9a6a26da-ff7a-4107-820d-e352c962870f service nova] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Received event network-vif-deleted-ed410f46-787b-4200-8216-e8678856af7f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-f3ba9afb-11ad-45f9-90a1-1a0657ba1ba5 req-9a6a26da-ff7a-4107-820d-e352c962870f service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3ba9afb-11ad-45f9-90a1-1a0657ba1ba5 req-9a6a26da-ff7a-4107-820d-e352c962870f service nova] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3ba9afb-11ad-45f9-90a1-1a0657ba1ba5 req-9a6a26da-ff7a-4107-820d-e352c962870f service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3ba9afb-11ad-45f9-90a1-1a0657ba1ba5 req-9a6a26da-ff7a-4107-820d-e352c962870f service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-f3ba9afb-11ad-45f9-90a1-1a0657ba1ba5 req-9a6a26da-ff7a-4107-820d-e352c962870f service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] No waiting events found dispatching network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:50 user nova-compute[71312]: WARNING nova.compute.manager [req-f3ba9afb-11ad-45f9-90a1-1a0657ba1ba5 req-9a6a26da-ff7a-4107-820d-e352c962870f service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received unexpected event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a for instance with vm_state building and task_state spawning.
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279431.0344877, 8216c52e-c0a7-42b1-9766-7bcffa376b28 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:03:51 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] VM Resumed (Lifecycle Event)
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:03:51 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Instance spawned successfully.
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:51 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279431.039016, 8216c52e-c0a7-42b1-9766-7bcffa376b28 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:03:51 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] VM Started (Lifecycle Event)
Jul 25 10:03:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:51 user nova-compute[71312]: INFO nova.compute.manager [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Took 5.53 seconds to spawn the instance on the hypervisor.
Jul 25 10:03:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:03:51 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:03:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:51 user nova-compute[71312]: INFO nova.compute.manager [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Took 20.54 seconds to build instance.
Jul 25 10:03:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35a349cc-3d19-44f0-9f75-1a2a50ce7653 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.684s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:51 user nova-compute[71312]: INFO nova.compute.manager [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Took 2.54 seconds to detach 3 volumes for instance.
Jul 25 10:03:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:52 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:03:52 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:03:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:52 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Deleted allocations for instance 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd
Jul 25 10:03:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3dc226da-5bfb-4407-9c9e-bd9b812b8d50 tempest-TaggedBootDevicesTest-886816588 tempest-TaggedBootDevicesTest-886816588-project-member] Lock "7e67c6e4-1c08-4d49-8537-5d0c9899c9bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.452s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa8bd0fb-cfea-40ed-9274-ab6b5e97bc6b req-9b77bfc5-e38a-45ba-8de7-2ca90f8afcdb service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Received event network-vif-plugged-100f3561-4981-45d9-add5-394b7e0be5bc {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa8bd0fb-cfea-40ed-9274-ab6b5e97bc6b req-9b77bfc5-e38a-45ba-8de7-2ca90f8afcdb service nova] Acquiring lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa8bd0fb-cfea-40ed-9274-ab6b5e97bc6b req-9b77bfc5-e38a-45ba-8de7-2ca90f8afcdb service nova] Lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa8bd0fb-cfea-40ed-9274-ab6b5e97bc6b req-9b77bfc5-e38a-45ba-8de7-2ca90f8afcdb service nova] Lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa8bd0fb-cfea-40ed-9274-ab6b5e97bc6b req-9b77bfc5-e38a-45ba-8de7-2ca90f8afcdb service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] No waiting events found dispatching network-vif-plugged-100f3561-4981-45d9-add5-394b7e0be5bc {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:52 user nova-compute[71312]: WARNING nova.compute.manager [req-fa8bd0fb-cfea-40ed-9274-ab6b5e97bc6b req-9b77bfc5-e38a-45ba-8de7-2ca90f8afcdb service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Received unexpected event network-vif-plugged-100f3561-4981-45d9-add5-394b7e0be5bc for instance with vm_state building and task_state spawning.
Jul 25 10:03:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa8bd0fb-cfea-40ed-9274-ab6b5e97bc6b req-9b77bfc5-e38a-45ba-8de7-2ca90f8afcdb service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Received event network-vif-plugged-100f3561-4981-45d9-add5-394b7e0be5bc {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:03:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa8bd0fb-cfea-40ed-9274-ab6b5e97bc6b req-9b77bfc5-e38a-45ba-8de7-2ca90f8afcdb service nova] Acquiring lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:03:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa8bd0fb-cfea-40ed-9274-ab6b5e97bc6b req-9b77bfc5-e38a-45ba-8de7-2ca90f8afcdb service nova] Lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:03:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa8bd0fb-cfea-40ed-9274-ab6b5e97bc6b req-9b77bfc5-e38a-45ba-8de7-2ca90f8afcdb service nova] Lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa8bd0fb-cfea-40ed-9274-ab6b5e97bc6b req-9b77bfc5-e38a-45ba-8de7-2ca90f8afcdb service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] No waiting events found dispatching network-vif-plugged-100f3561-4981-45d9-add5-394b7e0be5bc {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:03:52 user nova-compute[71312]: WARNING nova.compute.manager [req-fa8bd0fb-cfea-40ed-9274-ab6b5e97bc6b req-9b77bfc5-e38a-45ba-8de7-2ca90f8afcdb service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Received unexpected event network-vif-plugged-100f3561-4981-45d9-add5-394b7e0be5bc for instance with vm_state building and task_state spawning.
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279433.2877433, bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:03:53 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] VM Resumed (Lifecycle Event)
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:03:53 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Instance spawned successfully.
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:03:53 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279433.2899158, bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:03:53 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] VM Started (Lifecycle Event)
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:03:53 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:03:53 user nova-compute[71312]: INFO nova.compute.manager [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Took 5.72 seconds to spawn the instance on the hypervisor.
Jul 25 10:03:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:03:53 user nova-compute[71312]: INFO nova.compute.manager [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Took 6.67 seconds to build instance.
Jul 25 10:03:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e7fbcff-6ab0-4a8f-b6d7-4e4ed401c1e7 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.799s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:03:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:57 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279422.8576303, 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:03:57 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] VM Stopped (Lifecycle Event)
Jul 25 10:03:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c68e40d4-3759-4897-b8e9-95d02a340e19 None None] [instance: 7e67c6e4-1c08-4d49-8537-5d0c9899c9bd] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:03:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:03:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:00 user nova-compute[71312]: INFO nova.compute.manager [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Terminating instance
Jul 25 10:04:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:04:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-c2807172-f953-4f71-b34d-d5a5e6a145ce req-067f5b86-1c95-44e0-9933-999526a2ec98 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received event network-vif-unplugged-682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c2807172-f953-4f71-b34d-d5a5e6a145ce req-067f5b86-1c95-44e0-9933-999526a2ec98 service nova] Acquiring lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c2807172-f953-4f71-b34d-d5a5e6a145ce req-067f5b86-1c95-44e0-9933-999526a2ec98 service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c2807172-f953-4f71-b34d-d5a5e6a145ce req-067f5b86-1c95-44e0-9933-999526a2ec98 service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-c2807172-f953-4f71-b34d-d5a5e6a145ce req-067f5b86-1c95-44e0-9933-999526a2ec98 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] No waiting events found dispatching network-vif-unplugged-682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-c2807172-f953-4f71-b34d-d5a5e6a145ce req-067f5b86-1c95-44e0-9933-999526a2ec98 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received event network-vif-unplugged-682fce50-406a-4315-b5fc-b434a6c7c890 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:04:01 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Instance destroyed successfully.
Jul 25 10:04:01 user nova-compute[71312]: DEBUG nova.objects.instance [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lazy-loading 'resources' on Instance uuid c918b5d0-e8f8-40cc-9c25-71ea69d08756 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-282503515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-282503515',id=9,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfqLhAiM/fPqXox/lYYvHbsORMvG7EmhROMdWtJDW0gFjkybugS0JoPzqPg5A//Q1NyXk2q9pHeiid5wc4meqjPqIfzYlQ74CfLabiQCTkCNSfq5sY3vsH1zVkcnvVCvw==',key_name='tempest-keypair-791003982',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:01:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b5086ef6cce4cdfafc4a061ab06f894',ramdisk_id='',reservation_id='r-g6z0fs1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1298550074',owner_user_name='tempest-TaggedAttachmentsTest-1298550074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6325c3b752a4cd88b584d9acd06d537',uuid=c918b5d0-e8f8-40cc-9c25-71ea69d08756,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Converting VIF {"id": "682fce50-406a-4315-b5fc-b434a6c7c890", "address": "fa:16:3e:4a:96:ef", "network": {"id": "1555997f-e162-49c4-9513-24af3233ba3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1768068983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b5086ef6cce4cdfafc4a061ab06f894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682fce50-40", "ovs_interfaceid": "682fce50-406a-4315-b5fc-b434a6c7c890", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=682fce50-406a-4315-b5fc-b434a6c7c890,network=Network(1555997f-e162-49c4-9513-24af3233ba3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682fce50-40') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG os_vif [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=682fce50-406a-4315-b5fc-b434a6c7c890,network=Network(1555997f-e162-49c4-9513-24af3233ba3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682fce50-40') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap682fce50-40, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:01 user nova-compute[71312]: INFO os_vif [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=682fce50-406a-4315-b5fc-b434a6c7c890,network=Network(1555997f-e162-49c4-9513-24af3233ba3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682fce50-40')
Jul 25 10:04:01 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Deleting instance files /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756_del
Jul 25 10:04:01 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Deletion of /opt/stack/data/nova/instances/c918b5d0-e8f8-40cc-9c25-71ea69d08756_del complete
Jul 25 10:04:01 user nova-compute[71312]: INFO nova.compute.manager [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 25 10:04:01 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:04:01 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:04:02 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:04:02 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Took 1.11 seconds to deallocate network for instance.
Jul 25 10:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-f53126b1-34f4-4dab-b61d-0f9bdad48517 req-03586d3f-4ec5-4aed-b503-e80e0abb42d2 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received event network-vif-plugged-682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f53126b1-34f4-4dab-b61d-0f9bdad48517 req-03586d3f-4ec5-4aed-b503-e80e0abb42d2 service nova] Acquiring lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f53126b1-34f4-4dab-b61d-0f9bdad48517 req-03586d3f-4ec5-4aed-b503-e80e0abb42d2 service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f53126b1-34f4-4dab-b61d-0f9bdad48517 req-03586d3f-4ec5-4aed-b503-e80e0abb42d2 service nova] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-f53126b1-34f4-4dab-b61d-0f9bdad48517 req-03586d3f-4ec5-4aed-b503-e80e0abb42d2 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] No waiting events found dispatching network-vif-plugged-682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:04:03 user nova-compute[71312]: WARNING nova.compute.manager [req-f53126b1-34f4-4dab-b61d-0f9bdad48517 req-03586d3f-4ec5-4aed-b503-e80e0abb42d2 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received unexpected event network-vif-plugged-682fce50-406a-4315-b5fc-b434a6c7c890 for instance with vm_state deleted and task_state None.
Jul 25 10:04:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-f53126b1-34f4-4dab-b61d-0f9bdad48517 req-03586d3f-4ec5-4aed-b503-e80e0abb42d2 service nova] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Received event network-vif-deleted-682fce50-406a-4315-b5fc-b434a6c7c890 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:03 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:04:03 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:03 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Deleted allocations for instance c918b5d0-e8f8-40cc-9c25-71ea69d08756
Jul 25 10:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89137339-bf22-45d8-b495-91239ef5ece2 tempest-TaggedAttachmentsTest-1298550074 tempest-TaggedAttachmentsTest-1298550074-project-member] Lock "c918b5d0-e8f8-40cc-9c25-71ea69d08756" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.539s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG nova.objects.instance [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lazy-loading 'flavor' on Instance uuid 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279441.612507, c918b5d0-e8f8-40cc-9c25-71ea69d08756 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:04:16 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] VM Stopped (Lifecycle Event)
Jul 25 10:04:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b6bced67-e1ed-4553-b997-2c50477b6d82 None None] [instance: c918b5d0-e8f8-40cc-9c25-71ea69d08756] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:16 user nova-compute[71312]: INFO nova.compute.manager [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Attaching volume e3bd4850-4e1c-4068-b953-75f6c4c360ac to /dev/vdb
Jul 25 10:04:16 user nova-compute[71312]: DEBUG os_brick.utils [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[054938e6-8c4b-4bfc-bf5f-9f87b2c663a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28b3c40-e4c6-4f37-8a9c-98b393674d03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[14915036-4591-4659-8b92-5f71bf4c98f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e940d4e-2d58-4a5d-adc0-b8e9afa4ddfb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:04:16 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:04:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e4cf51-f251-495f-8441-884c0931ce62]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG os_brick.utils [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:04:16 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updating existing volume attachment record: 672c99b9-d7da-4d5e-a93c-ee261399b331 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:04:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'flavor' on Instance uuid bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:19 user nova-compute[71312]: INFO nova.compute.manager [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Attaching volume 9bca412d-abf2-4775-898b-4dc48badc670 to /dev/vdb
Jul 25 10:04:20 user nova-compute[71312]: DEBUG os_brick.utils [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3976cd59-ff39-4cf4-b783-bf0b22ffc488]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a74dff-b750-4121-82bc-53299ee22a97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bffcc32-3d6b-4478-9c37-260cf9107439]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94c651b-666b-4afe-a178-c30f325f4dd0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:04:20 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11cac44-2fdf-4d03-a534-358166888937]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG os_brick.utils [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updating existing volume attachment record: 71be8885-fd36-44ed-8abb-2ca38cb591b4 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:04:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updating instance_info_cache with network_info: [{"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgKmjAwp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:24 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:24 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:24 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd9f180-066b-44c4-beeb-151e7db80f01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:04:24 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c797d01-aa61-4867-8b8e-c277b8e0cfbb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac] added
Jul 25 10:04:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[058a70b3-46f0-44de-87d2-49bc398de75b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df63cb9-8edf-406f-8eaa-9a4410ea6bc3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgKmjAwp {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgKmjAwp" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9f1d31-7cc7-4b12-a91d-b58d3fd4f280]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IgKmjAwp'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ab8ba0-4ce4-45da-bd9e-feda99ffb3d7]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea88e0c-cbe3-44d4-bcbe-edc948638792]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:24 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:24 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:24 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:24 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4b5f59-ee6f-4430-827c-f1b9128d7d92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260]
Jul 25 10:04:24 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260] successful.
Jul 25 10:04:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[31411bdc-7008-4420-97c9-6602021e1efa]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7b868b-cc9e-40a3-8913-e76e5b65cebe]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:24 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:24 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:24 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:24 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:24 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:24 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[568116b3-0216-45e2-b50f-49f4c05e9aea]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgKmjAwp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:04:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:04:25 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:04:25 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7503MB free_disk=25.501117706298828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23236323063383638', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236323063383638', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9fb85501-6210-4bfd-b496-1891c79fd23c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 297fe407-3797-4681-ba83-e0f296780d57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 50f8683d-8b60-4095-9507-a969c37f85e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.objects.instance [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lazy-loading 'flavor' on Instance uuid 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:04:25 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:04:25 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:04:25 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:04:25 user nova-compute[71312]:   <serial>e3bd4850-4e1c-4068-b953-75f6c4c360ac</serial>
Jul 25 10:04:25 user nova-compute[71312]: </disk>
Jul 25 10:04:25 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:04:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] No VIF found with MAC fa:16:3e:60:72:df, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:04:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-04c4f63c-fc71-4f7d-8d60-bf8f94d91673 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.350s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:26 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lazy-loading 'flavor' on Instance uuid cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.112s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:26 user nova-compute[71312]: INFO nova.compute.manager [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Attaching volume 2616108b-d5a6-4bec-a913-8f7858013120 to /dev/vdb
Jul 25 10:04:27 user nova-compute[71312]: DEBUG os_brick.utils [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[89649c5a-3e49-4044-a965-3e48f8eedfd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece51b84-ab93-4571-b206-77a2a0911e09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddfd245-249f-4ef0-aa1d-1ede32959aa9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ef7347-4c73-42f4-b016-fb8abeac366f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:04:27 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[894f996d-4e9e-4e65-9a27-98f3898c4389]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG os_brick.utils [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Updating existing volume attachment record: 4ba69046-43c6-491d-a433-69c981bb594a {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG nova.objects.instance [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'flavor' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquired lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:04:27 user nova-compute[71312]: DEBUG nova.objects.instance [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'info_cache' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Updating instance_info_cache with network_info: [{"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Releasing lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:04:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Instance destroyed successfully.
Jul 25 10:04:28 user nova-compute[71312]: DEBUG nova.objects.instance [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'resources' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-144544124',display_name='tempest-AttachVolumeTestJSON-server-144544124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-144544124',id=1,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXz0IZaYzGqFbEgiNbRhFKdSJm7XWgEwVt5cEq+cvPNuokJAodyfDggfS0UAjnFMJC0mA942niA5C8O8meI4xtkMoQ/wHBJsXHFttAfgGOUxF17NM8ZbF6FsKSU7eOZoQ==',key_name='tempest-keypair-2122772756',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='68cb9228183844d5853c6c2a35f2658f',ramdisk_id='',reservation_id='r-il07codx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095711794',owner_user_name='tempest-AttachVolumeTestJSON-1095711794-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48272d2a58644b2b8b6a9c42b51c746',uuid=a35abe6a-0a8b-4eb2-8781-85b99539d1fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converting VIF {"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_vif [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8954e08-0e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:28 user nova-compute[71312]: INFO os_vif [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e')
Jul 25 10:04:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GVIHKNSo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:28 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[552c4674-b6e5-4d29-8dc8-bbeecc5bf19b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:04:28 user nova-compute[71312]: No targets found.
Jul 25 10:04:28 user nova-compute[71312]: iSNS:
Jul 25 10:04:28 user nova-compute[71312]: No targets found.
Jul 25 10:04:28 user nova-compute[71312]: STATIC:
Jul 25 10:04:28 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac
Jul 25 10:04:28 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:28 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:28 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:04:28 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:28 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:28 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9
Jul 25 10:04:28 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:28 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:28 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:04:28 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:28 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:28 user nova-compute[71312]: FIRMWARE:
Jul 25 10:04:28 user nova-compute[71312]: No targets found.
Jul 25 10:04:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:04:28 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:04:28 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cca3b4-1c85-4a18-91aa-c94ceb47b090]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5617ad7f-2d37-436f-8f62-44c4959cfc73]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:28 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:28 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:28 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:28 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:28 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:28 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9cee305e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243'): ({'sde'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Removing single pathed devices sde {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c1d4cb-f860-47f8-a246-f6ccb198a6e3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[92284957-44d3-4f3b-b0c6-ba822a1c28b9]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Flushing IO for device /dev/sde {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[95391447-11c3-41de-a67b-6a259de1d884]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2f99a1-b2bc-465a-b086-e53618ee571b]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e3beb7-070e-4f39-8632-9560143fc64c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[689d9117-8226-4113-88fb-a64692f5737f]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260]
Jul 25 10:04:28 user nova-compute[71312]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260] successful.
Jul 25 10:04:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[325c152c-394d-4641-a16c-af6ccde4549c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] <== disconnect_volume: return (332ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Start _get_guest_xml network_info=[{"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '462ec86e-8fa3-4663-b7bb-9a0e42a0e97e', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GVIHKNSo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'a35abe6a-0a8b-4eb2-8781-85b99539d1fc', 'attached_at': '', 'detached_at': '', 'volume_id': '5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243', 'serial': '5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'numa_topology' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:29 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:04:29 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'vcpu_model' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GVIHKNSo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:29 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:29 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:29 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e94c96-5ba5-4702-99c3-1a50506ec000]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:04:29 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1fa278-69f2-465b-ac43-8ab0bc329cca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243] added
Jul 25 10:04:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Stashing vm_state: active {{(pid=71312) _prep_resize /opt/stack/nova/nova/compute/manager.py:5529}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded1c838-35c4-4727-92a1-6cf32b3c6b15]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dfe832-1765-4a3b-a404-d7c49bf6fd50]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GVIHKNSo {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GVIHKNSo" returned: 0 in 0.105s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffe7c8d-465d-4736-b9da-0e5cbbf77fa6]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GVIHKNSo'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f4efdd-9146-40af-a8a9-dfd4023bea60]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d225e39-77c9-48a0-af05-3064c23a783c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:29 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:29 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:29 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:29 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lazy-loading 'pci_requests' on Instance uuid 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:04:29 user nova-compute[71312]: INFO nova.compute.claims [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Claim successful on node user
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lazy-loading 'resources' on Instance uuid 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[191ab7c2-0200-4248-b348-0e2f17372485]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260]
Jul 25 10:04:29 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260] successful.
Jul 25 10:04:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeafaad-9121-4974-9e1d-c26c76653c99]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:29 user nova-compute[71312]: INFO nova.compute.resource_tracker [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updating resource usage from migration c8f3e6ea-9ac0-45e8-a406-6689fa99cba8
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc046455-a42c-4195-8665-80bd8b5fcf39]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:29 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:29 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:29 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:29 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:29 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:29 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.433s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39ec7aa-a1c3-4a5d-a87f-a5faa334a94f]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.568s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:29 user nova-compute[71312]: INFO nova.compute.manager [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Migrating
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:04:29 user nova-compute[71312]: INFO nova.compute.rpcapi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 25 10:04:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquired lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GVIHKNSo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '26662303532656230', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662303532656230', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-144544124',display_name='tempest-AttachVolumeTestJSON-server-144544124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-144544124',id=1,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXz0IZaYzGqFbEgiNbRhFKdSJm7XWgEwVt5cEq+cvPNuokJAodyfDggfS0UAjnFMJC0mA942niA5C8O8meI4xtkMoQ/wHBJsXHFttAfgGOUxF17NM8ZbF6FsKSU7eOZoQ==',key_name='tempest-keypair-2122772756',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='68cb9228183844d5853c6c2a35f2658f',ramdisk_id='',reservation_id='r-il07codx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095711794',owner_user_name='tempest-AttachVolumeTestJSON-1095711794-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48272d2a58644b2b8b6a9c42b51c746',uuid=a35abe6a-0a8b-4eb2-8781-85b99539d1fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converting VIF {"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG nova.objects.instance [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'pci_devices' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:04:30 user nova-compute[71312]:   <uuid>a35abe6a-0a8b-4eb2-8781-85b99539d1fc</uuid>
Jul 25 10:04:30 user nova-compute[71312]:   <name>instance-00000001</name>
Jul 25 10:04:30 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:04:30 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:04:30 user nova-compute[71312]:   <metadata>
Jul 25 10:04:30 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:04:30 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:04:30 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeTestJSON-server-144544124</nova:name>
Jul 25 10:04:30 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:04:29</nova:creationTime>
Jul 25 10:04:30 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:04:30 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:04:30 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:04:30 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:04:30 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:04:30 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:04:30 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:04:30 user nova-compute[71312]:       <nova:owner>
Jul 25 10:04:30 user nova-compute[71312]:         <nova:user uuid="c48272d2a58644b2b8b6a9c42b51c746">tempest-AttachVolumeTestJSON-1095711794-project-member</nova:user>
Jul 25 10:04:30 user nova-compute[71312]:         <nova:project uuid="68cb9228183844d5853c6c2a35f2658f">tempest-AttachVolumeTestJSON-1095711794</nova:project>
Jul 25 10:04:30 user nova-compute[71312]:       </nova:owner>
Jul 25 10:04:30 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:04:30 user nova-compute[71312]:       <nova:ports>
Jul 25 10:04:30 user nova-compute[71312]:         <nova:port uuid="c8954e08-0e8d-41ae-9080-1eb363124b32">
Jul 25 10:04:30 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 10:04:30 user nova-compute[71312]:         </nova:port>
Jul 25 10:04:30 user nova-compute[71312]:       </nova:ports>
Jul 25 10:04:30 user nova-compute[71312]:     </nova:instance>
Jul 25 10:04:30 user nova-compute[71312]:   </metadata>
Jul 25 10:04:30 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:04:30 user nova-compute[71312]:     <system>
Jul 25 10:04:30 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:04:30 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:04:30 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:04:30 user nova-compute[71312]:       <entry name="serial">a35abe6a-0a8b-4eb2-8781-85b99539d1fc</entry>
Jul 25 10:04:30 user nova-compute[71312]:       <entry name="uuid">a35abe6a-0a8b-4eb2-8781-85b99539d1fc</entry>
Jul 25 10:04:30 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:04:30 user nova-compute[71312]:     </system>
Jul 25 10:04:30 user nova-compute[71312]:   </sysinfo>
Jul 25 10:04:30 user nova-compute[71312]:   <os>
Jul 25 10:04:30 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:04:30 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:04:30 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:04:30 user nova-compute[71312]:   </os>
Jul 25 10:04:30 user nova-compute[71312]:   <features>
Jul 25 10:04:30 user nova-compute[71312]:     <acpi/>
Jul 25 10:04:30 user nova-compute[71312]:     <apic/>
Jul 25 10:04:30 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:04:30 user nova-compute[71312]:   </features>
Jul 25 10:04:30 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:04:30 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:04:30 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:04:30 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:04:30 user nova-compute[71312]:   </clock>
Jul 25 10:04:30 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:04:30 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:04:30 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:04:30 user nova-compute[71312]:   </cpu>
Jul 25 10:04:30 user nova-compute[71312]:   <devices>
Jul 25 10:04:30 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:04:30 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:04:30 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk"/>
Jul 25 10:04:30 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:04:30 user nova-compute[71312]:     </disk>
Jul 25 10:04:30 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:04:30 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:04:30 user nova-compute[71312]:       <source dev="/dev/sdd"/>
Jul 25 10:04:30 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Jul 25 10:04:30 user nova-compute[71312]:       <serial>5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243</serial>
Jul 25 10:04:30 user nova-compute[71312]:     </disk>
Jul 25 10:04:30 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:04:30 user nova-compute[71312]:       <mac address="fa:16:3e:3d:6d:80"/>
Jul 25 10:04:30 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:04:30 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:04:30 user nova-compute[71312]:       <target dev="tapc8954e08-0e"/>
Jul 25 10:04:30 user nova-compute[71312]:     </interface>
Jul 25 10:04:30 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:04:30 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/console.log" append="off"/>
Jul 25 10:04:30 user nova-compute[71312]:     </serial>
Jul 25 10:04:30 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:04:30 user nova-compute[71312]:     <video>
Jul 25 10:04:30 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:04:30 user nova-compute[71312]:     </video>
Jul 25 10:04:30 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:04:30 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:04:30 user nova-compute[71312]:     </rng>
Jul 25 10:04:30 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:04:30 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:04:30 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:04:30 user nova-compute[71312]:     </memballoon>
Jul 25 10:04:30 user nova-compute[71312]:   </devices>
Jul 25 10:04:30 user nova-compute[71312]: </domain>
Jul 25 10:04:30 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updating instance_info_cache with network_info: [{"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Releasing lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG nova.objects.instance [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'trusted_certs' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Starting migrate_disk_and_power_off {{(pid=71312) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Cannot resize image /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG nova.objects.instance [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'migration_context' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-144544124',display_name='tempest-AttachVolumeTestJSON-server-144544124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-144544124',id=1,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXz0IZaYzGqFbEgiNbRhFKdSJm7XWgEwVt5cEq+cvPNuokJAodyfDggfS0UAjnFMJC0mA942niA5C8O8meI4xtkMoQ/wHBJsXHFttAfgGOUxF17NM8ZbF6FsKSU7eOZoQ==',key_name='tempest-keypair-2122772756',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='68cb9228183844d5853c6c2a35f2658f',ramdisk_id='',reservation_id='r-il07codx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095711794',owner_user_name='tempest-AttachVolumeTestJSON-1095711794-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48272d2a58644b2b8b6a9c42b51c746',uuid=a35abe6a-0a8b-4eb2-8781-85b99539d1fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converting VIF {"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_vif [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8954e08-0e, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8954e08-0e, col_values=(('external_ids', {'iface-id': 'c8954e08-0e8d-41ae-9080-1eb363124b32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:6d:80', 'vm-uuid': 'a35abe6a-0a8b-4eb2-8781-85b99539d1fc'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:31 user nova-compute[71312]: INFO os_vif [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e')
Jul 25 10:04:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEIBehbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:31 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:31 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:31 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc87d602-a8b7-4c24-8bff-97132ee748bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:04:31 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6aa4b3-e9cf-4988-bec1-b3f07fd93acc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670] added
Jul 25 10:04:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae18341b-cb08-4fb5-b475-df08762b25b4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02af23f-7c89-4adf-b99e-57846814a95a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pEIBehbX {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-03b61411-11ca-4696-bf0b-4071dc3176e2 req-573763b2-09df-49d1-8d57-df15b1ac9629 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-vif-unplugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-03b61411-11ca-4696-bf0b-4071dc3176e2 req-573763b2-09df-49d1-8d57-df15b1ac9629 service nova] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-03b61411-11ca-4696-bf0b-4071dc3176e2 req-573763b2-09df-49d1-8d57-df15b1ac9629 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-03b61411-11ca-4696-bf0b-4071dc3176e2 req-573763b2-09df-49d1-8d57-df15b1ac9629 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-03b61411-11ca-4696-bf0b-4071dc3176e2 req-573763b2-09df-49d1-8d57-df15b1ac9629 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] No waiting events found dispatching network-vif-unplugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:04:31 user nova-compute[71312]: WARNING nova.compute.manager [req-03b61411-11ca-4696-bf0b-4071dc3176e2 req-573763b2-09df-49d1-8d57-df15b1ac9629 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received unexpected event network-vif-unplugged-8727a126-c33f-4868-8651-45e7c1f663d2 for instance with vm_state active and task_state resize_migrating.
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pEIBehbX" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a45a210-00c8-4506-97ad-23e3c1e44ec9]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pEIBehbX'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4a23e8-b631-4ffc-b945-7840e86e53ae]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[771efc60-cf83-481e-8eab-4223cc6fcd77]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:31 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:31 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:31 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:31 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:31 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:31 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb81904-3ada-4faa-8230-63468d6a404b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260]
Jul 25 10:04:31 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260] successful.
Jul 25 10:04:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.186s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a530b21-8fe1-4c60-8d8d-88fcc8d2518f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9f2c07-6e7f-463f-8e7f-b0f987f1ad8c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:31 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:31 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:31 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:04:31 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:31 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:31 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:31 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:04:31 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.517s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] HCTL ('36', '-', '-', 0) found on session 14 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.048s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[900f0be8-6050-4f25-ae22-9f92760f715d]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:04:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEIBehbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:04:32 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Instance destroyed successfully.
Jul 25 10:04:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704266463',display_name='tempest-ServerActionsTestOtherB-server-704266463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704266463',id=4,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeo1OyzMR1FuY3t9bxVf78EYsomUcs1GBJeQZ+xHk7Q6n7Ea0otdZoq9Stbi9efTSjxNpLsJBFIquobgg119YA0SZsVMkFCxXfGhMNAahmBkXlggOo2Y7cPMghqdLy6UQ==',key_name='tempest-keypair-1722521166',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='39ace30139b94322bdc7a657d3546757',ramdisk_id='',reservation_id='r-x9ogqxil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-766110382',owner_user_name='tempest-ServerActionsTestOtherB-766110382-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:04:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5186cf6b19094cb2948a2d4f966f3dcc',uuid=9fb85501-6210-4bfd-b496-1891c79fd23c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1712941866-network", "vif_mac": "fa:16:3e:60:72:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converting VIF {"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1712941866-network", "vif_mac": "fa:16:3e:60:72:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG os_vif [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8727a126-c3, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:04:32 user nova-compute[71312]: INFO os_vif [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3')
Jul 25 10:04:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgKmjAwp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:32 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:04:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.584s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] <== connect_volume: return (1587ms) {'type': 'block', 'scsi_wwn': '23137326332363035', 'path': '/dev/sde'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137326332363035', 'path': '/dev/sde'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.388s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'flavor' on Instance uuid bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c12c8da-c4e4-461d-8893-61182a1e5d3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:04:32 user nova-compute[71312]: No targets found.
Jul 25 10:04:32 user nova-compute[71312]: iSNS:
Jul 25 10:04:32 user nova-compute[71312]: No targets found.
Jul 25 10:04:32 user nova-compute[71312]: STATIC:
Jul 25 10:04:32 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac
Jul 25 10:04:32 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:32 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:32 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:04:32 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:32 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:32 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9
Jul 25 10:04:32 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:32 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:32 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:04:32 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:32 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:32 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670
Jul 25 10:04:32 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:32 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:32 user nova-compute[71312]: FIRMWARE:
Jul 25 10:04:32 user nova-compute[71312]: No targets found.
Jul 25 10:04:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:04:32 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:04:32 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:04:32 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:04:32 user nova-compute[71312]:   <source dev="/dev/sde"/>
Jul 25 10:04:32 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:04:32 user nova-compute[71312]:   <serial>9bca412d-abf2-4775-898b-4dc48badc670</serial>
Jul 25 10:04:32 user nova-compute[71312]: </disk>
Jul 25 10:04:32 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[526538ba-c091-42b1-8a2e-0cdfd43b4595]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9172e185-914b-4473-a489-523d43fcedac]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:33 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:33 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:33 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:04:33 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:33 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:33 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:33 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:33 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:04:33 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:33 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9cee33010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe67731-00b4-4e4a-86a2-4c1b53196f83]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc49576f-8760-403c-92b0-cdf8e3316023]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[773e75d7-9822-42ac-a81c-bb9dea0a4e05]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2440631-5c60-4cca-972a-bbcf3691419e]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f331d57-04ea-4ef4-8784-97d5c40ad515]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c857cc9b-f2dd-4c8b-bb68-0593fdd331b9]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260]
Jul 25 10:04:33 user nova-compute[71312]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260] successful.
Jul 25 10:04:33 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf749ef-d56f-45fe-89cd-ccba826ad5ab]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] <== disconnect_volume: return (772ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-13501a23-f689-4d85-a60a-c01f5b1fd858 req-3fc4d3a2-54b1-4327-887a-6016c2057c67 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-13501a23-f689-4d85-a60a-c01f5b1fd858 req-3fc4d3a2-54b1-4327-887a-6016c2057c67 service nova] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-13501a23-f689-4d85-a60a-c01f5b1fd858 req-3fc4d3a2-54b1-4327-887a-6016c2057c67 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-13501a23-f689-4d85-a60a-c01f5b1fd858 req-3fc4d3a2-54b1-4327-887a-6016c2057c67 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-13501a23-f689-4d85-a60a-c01f5b1fd858 req-3fc4d3a2-54b1-4327-887a-6016c2057c67 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] No waiting events found dispatching network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:04:33 user nova-compute[71312]: WARNING nova.compute.manager [req-13501a23-f689-4d85-a60a-c01f5b1fd858 req-3fc4d3a2-54b1-4327-887a-6016c2057c67 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received unexpected event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 for instance with vm_state stopped and task_state powering-on.
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-64cc9f8a-173c-407f-af6b-95d7e8140c64 req-e695f134-ac46-4b82-9c7f-669ae2bfbb70 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-64cc9f8a-173c-407f-af6b-95d7e8140c64 req-e695f134-ac46-4b82-9c7f-669ae2bfbb70 service nova] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-64cc9f8a-173c-407f-af6b-95d7e8140c64 req-e695f134-ac46-4b82-9c7f-669ae2bfbb70 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-64cc9f8a-173c-407f-af6b-95d7e8140c64 req-e695f134-ac46-4b82-9c7f-669ae2bfbb70 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-64cc9f8a-173c-407f-af6b-95d7e8140c64 req-e695f134-ac46-4b82-9c7f-669ae2bfbb70 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] No waiting events found dispatching network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:04:33 user nova-compute[71312]: WARNING nova.compute.manager [req-64cc9f8a-173c-407f-af6b-95d7e8140c64 req-e695f134-ac46-4b82-9c7f-669ae2bfbb70 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received unexpected event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 for instance with vm_state active and task_state resize_migrating.
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c_resize/disk /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] No VIF found with MAC fa:16:3e:e9:8e:2b, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7fbfef72-9479-4c4e-a5f0-cb0cfe634554 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.038s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CMD "cp -r /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c_resize/disk /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk" returned: 0 in 0.602s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c_resize/disk.info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk.info {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CMD "cp -r /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c_resize/disk.info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk.info" returned: 0 in 0.041s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUxINHur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:35 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:35 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:35 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:35 user nova-compute[71312]: INFO nova.compute.manager [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Rebuilding instance
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed0121d-2c92-4649-a6a3-92c7cf15d496]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:04:35 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[521a676a-6988-4742-b8d5-1b23c0acc81e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120] added
Jul 25 10:04:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'trusted_certs' on Instance uuid bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f92584-1296-40f3-826d-c2e91262a4b2]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e70b173-43fb-49fd-a037-367b5b2d68b9]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUxINHur {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUxINHur" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[54edb0bd-f406-4ca5-a7f6-6f4d0b7d0eb4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kUxINHur'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'pci_requests' on Instance uuid bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[10842348-219a-46c7-af62-08a4a300686c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'pci_devices' on Instance uuid bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad7439d-db89-4830-a13b-134a3eb35743]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'resources' on Instance uuid bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'migration_context' on Instance uuid bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71312) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-f96cd3ce-6e3d-45b4-9fe2-9bf564142feb req-bfffe7dd-e850-4bb6-949e-48926ae60559 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f96cd3ce-6e3d-45b4-9fe2-9bf564142feb req-bfffe7dd-e850-4bb6-949e-48926ae60559 service nova] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f96cd3ce-6e3d-45b4-9fe2-9bf564142feb req-bfffe7dd-e850-4bb6-949e-48926ae60559 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f96cd3ce-6e3d-45b4-9fe2-9bf564142feb req-bfffe7dd-e850-4bb6-949e-48926ae60559 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-f96cd3ce-6e3d-45b4-9fe2-9bf564142feb req-bfffe7dd-e850-4bb6-949e-48926ae60559 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] No waiting events found dispatching network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:04:35 user nova-compute[71312]: WARNING nova.compute.manager [req-f96cd3ce-6e3d-45b4-9fe2-9bf564142feb req-bfffe7dd-e850-4bb6-949e-48926ae60559 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received unexpected event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 for instance with vm_state stopped and task_state powering-on.
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f11ee27-8c77-4579-8954-cc3b059916c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120, portal: 172.16.0.220,3260]
Jul 25 10:04:35 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120, portal: 172.16.0.220,3260] successful.
Jul 25 10:04:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a9f07c-364a-4d14-8012-cded9d66b2e5]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3846d80f-29cd-410e-9853-dd6925886470]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef97e6d-4a6a-40d8-8438-8c4ed3770263]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279476.102265, a35abe6a-0a8b-4eb2-8781-85b99539d1fc => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:04:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] VM Resumed (Lifecycle Event)
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:04:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Instance rebooted successfully.
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-50e259f9-c2fa-49c8-aebd-dab342cfa255 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:04:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279476.1043088, a35abe6a-0a8b-4eb2-8781-85b99539d1fc => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:04:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] VM Started (Lifecycle Event)
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 25 10:04:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Instance destroyed successfully.
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-84e842fb-568d-4c90-b493-00c962f6d132 req-622be1b7-c458-43e4-8dcc-ef4b454c58f8 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-unplugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-84e842fb-568d-4c90-b493-00c962f6d132 req-622be1b7-c458-43e4-8dcc-ef4b454c58f8 service nova] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-84e842fb-568d-4c90-b493-00c962f6d132 req-622be1b7-c458-43e4-8dcc-ef4b454c58f8 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-84e842fb-568d-4c90-b493-00c962f6d132 req-622be1b7-c458-43e4-8dcc-ef4b454c58f8 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-84e842fb-568d-4c90-b493-00c962f6d132 req-622be1b7-c458-43e4-8dcc-ef4b454c58f8 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] No waiting events found dispatching network-vif-unplugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:04:36 user nova-compute[71312]: WARNING nova.compute.manager [req-84e842fb-568d-4c90-b493-00c962f6d132 req-622be1b7-c458-43e4-8dcc-ef4b454c58f8 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received unexpected event network-vif-unplugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 for instance with vm_state active and task_state rebuilding.
Jul 25 10:04:36 user nova-compute[71312]: INFO nova.compute.manager [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Detaching volume 9bca412d-abf2-4775-898b-4dc48badc670
Jul 25 10:04:36 user nova-compute[71312]: INFO nova.virt.block_device [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Attempting to driver detach volume 9bca412d-abf2-4775-898b-4dc48badc670 from mountpoint /dev/vdb
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Attempting to detach device vdb from instance bcc93774-32b0-4592-bf6a-d655bac21d39 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:04:36 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:04:36 user nova-compute[71312]:   <source dev="/dev/sde"/>
Jul 25 10:04:36 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:04:36 user nova-compute[71312]:   <serial>9bca412d-abf2-4775-898b-4dc48badc670</serial>
Jul 25 10:04:36 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:04:36 user nova-compute[71312]: </disk>
Jul 25 10:04:36 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:04:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Successfully detached device vdb from instance bcc93774-32b0-4592-bf6a-d655bac21d39 from the persistent domain config.
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEIBehbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:36 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUxINHur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '23865356131363033', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865356131363033', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.068s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lazy-loading 'flavor' on Instance uuid cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[616a0108-b062-4bc8-b875-7309721f757b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:04:36 user nova-compute[71312]: No targets found.
Jul 25 10:04:36 user nova-compute[71312]: iSNS:
Jul 25 10:04:36 user nova-compute[71312]: No targets found.
Jul 25 10:04:36 user nova-compute[71312]: STATIC:
Jul 25 10:04:36 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:04:36 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:36 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:36 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9
Jul 25 10:04:36 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:36 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:36 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:04:36 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:36 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:36 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670
Jul 25 10:04:36 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:36 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:36 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120
Jul 25 10:04:36 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:36 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:36 user nova-compute[71312]: FIRMWARE:
Jul 25 10:04:36 user nova-compute[71312]: No targets found.
Jul 25 10:04:36 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:04:36 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:04:36 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:04:36 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:04:36 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:04:36 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:04:36 user nova-compute[71312]:   <serial>2616108b-d5a6-4bec-a913-8f7858013120</serial>
Jul 25 10:04:36 user nova-compute[71312]: </disk>
Jul 25 10:04:36 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.050s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[37428341-e4da-44fc-8fbd-3d9e367a6aef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19cbacd-8af4-4005-908e-a0de0392b333]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:36 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:36 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:04:36 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:04:36 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:36 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:36 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:36 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:04:36 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:04:36 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:36 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a8620b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670'): ({'sde'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Removing single pathed devices sde {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d313b367-054f-48eb-8f5e-6ed30c65a600]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.034s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1006f397-a155-4239-8fa9-6b115b6facbb]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Flushing IO for device /dev/sde {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6993309a-f3c1-472b-968e-3bfc0d096f34]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:04:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a057d6-c8d5-49d6-95e5-46c51fdf7330]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b84d890-00cd-4950-8edc-65e1f6555658]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Port 8727a126-c33f-4868-8651-45e7c1f663d2 binding to destination host user is already ACTIVE {{(pid=71312) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00dcad9-2191-435c-b3fa-568a13e66032]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260]
Jul 25 10:04:37 user nova-compute[71312]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260] successful.
Jul 25 10:04:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5483f7fc-4ecd-408b-99d8-ee351342fc23]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.509s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] <== disconnect_volume: return (578ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] No VIF found with MAC fa:16:3e:77:36:b8, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8aeee721-5bc3-48fc-9f3c-88670b4a5549 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.518s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquired lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:04:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:04:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-a2a4a1a5-30bb-4ef9-b6e8-8fff701cef7d req-f75fce9e-53e7-4234-a007-f3e908d59b29 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a2a4a1a5-30bb-4ef9-b6e8-8fff701cef7d req-f75fce9e-53e7-4234-a007-f3e908d59b29 service nova] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a2a4a1a5-30bb-4ef9-b6e8-8fff701cef7d req-f75fce9e-53e7-4234-a007-f3e908d59b29 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a2a4a1a5-30bb-4ef9-b6e8-8fff701cef7d req-f75fce9e-53e7-4234-a007-f3e908d59b29 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-a2a4a1a5-30bb-4ef9-b6e8-8fff701cef7d req-f75fce9e-53e7-4234-a007-f3e908d59b29 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] No waiting events found dispatching network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:04:38 user nova-compute[71312]: WARNING nova.compute.manager [req-a2a4a1a5-30bb-4ef9-b6e8-8fff701cef7d req-f75fce9e-53e7-4234-a007-f3e908d59b29 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received unexpected event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 for instance with vm_state active and task_state rebuilding.
Jul 25 10:04:38 user nova-compute[71312]: INFO nova.compute.manager [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Rescuing
Jul 25 10:04:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:04:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquired lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:04:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Updating instance_info_cache with network_info: [{"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:04:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Instance destroyed successfully.
Jul 25 10:04:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-164940161',display_name='tempest-ServerActionsTestOtherA-server-1344752152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-164940161',id=5,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7/PiN27E1zNONLGfU75gjTzl6TjLJTSPguo/w/NLGiNWvcFBQAXJk/RsZr2x3/TDzaN8UL9NG26qh75+qbwT35akc6FqjZaWZn3poJMiar+SGmPPXZDxAQP/CqYmNQIw==',key_name='tempest-keypair-2143034637',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c30d33a1a8945fdab6798c94a558444',ramdisk_id='',reservation_id='r-rxkl8cmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-408585031',owner_user_name='tempest-ServerActionsTestOtherA-408585031-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:04:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfdced66e34e0ba7f9437e71aaee6a',uuid=bcc93774-32b0-4592-bf6a-d655bac21d39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converting VIF {"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=d1cb436a-ed84-43ea-a32f-6c08effc60d6,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb436a-ed') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_vif [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=d1cb436a-ed84-43ea-a32f-6c08effc60d6,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb436a-ed') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1cb436a-ed, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Releasing lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:04:39 user nova-compute[71312]: INFO os_vif [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=d1cb436a-ed84-43ea-a32f-6c08effc60d6,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb436a-ed')
Jul 25 10:04:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEIBehbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:39 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a3b9da-00bd-451e-9373-389c226afcf8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:04:39 user nova-compute[71312]: No targets found.
Jul 25 10:04:39 user nova-compute[71312]: iSNS:
Jul 25 10:04:39 user nova-compute[71312]: No targets found.
Jul 25 10:04:39 user nova-compute[71312]: STATIC:
Jul 25 10:04:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:04:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:39 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9
Jul 25 10:04:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:39 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:04:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:39 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120
Jul 25 10:04:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:04:39 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:04:39 user nova-compute[71312]: FIRMWARE:
Jul 25 10:04:39 user nova-compute[71312]: No targets found.
Jul 25 10:04:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:04:39 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:04:39 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a529cc-0d8c-407d-abf7-9bd80bba9d9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[119f4e07-da71-4a58-bb67-7029e78a4aa6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:39 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:39 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:04:39 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:39 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:39 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:04:39 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c976d1b0>, {}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Disconnecting from: [] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.114s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] <== disconnect_volume: return (115ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:04:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Deleting instance files /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39_del
Jul 25 10:04:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Deletion of /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39_del complete
Jul 25 10:04:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updating instance_info_cache with network_info: [{"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:04:39 user nova-compute[71312]: INFO nova.virt.block_device [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Booting with volume 9bca412d-abf2-4775-898b-4dc48badc670 at /dev/vdb
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Releasing lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.utils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f19dbd-c0a9-42d8-bdb2-a78d9f25949c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.utils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.033s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3a8044-3f30-4c29-b883-b089d9debb78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e053eb-ece9-4926-b9c6-696ffe10af35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7385beff-be62-4b14-8ee3-5ddacd9277d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4905512f-00a2-445a-9ede-fb1262c8b7ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ca39ed-412a-461a-8df4-964e279546f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG nova.compute.manager [req-b69777af-b1a3-4ad9-92ac-2761e40a4531 req-b6487632-3bef-4d21-9a60-b0651830c223 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-vif-unplugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b69777af-b1a3-4ad9-92ac-2761e40a4531 req-b6487632-3bef-4d21-9a60-b0651830c223 service nova] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b69777af-b1a3-4ad9-92ac-2761e40a4531 req-b6487632-3bef-4d21-9a60-b0651830c223 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b69777af-b1a3-4ad9-92ac-2761e40a4531 req-b6487632-3bef-4d21-9a60-b0651830c223 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG nova.compute.manager [req-b69777af-b1a3-4ad9-92ac-2761e40a4531 req-b6487632-3bef-4d21-9a60-b0651830c223 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] No waiting events found dispatching network-vif-unplugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:04:39 user nova-compute[71312]: WARNING nova.compute.manager [req-b69777af-b1a3-4ad9-92ac-2761e40a4531 req-b6487632-3bef-4d21-9a60-b0651830c223 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received unexpected event network-vif-unplugged-63f89ec1-70e3-4e23-ad25-c0f935da374d for instance with vm_state active and task_state rescuing.
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:04:39 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60bd27e-966d-4f0b-8257-84559352ecee]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[982b85bd-be52-4c80-9bf2-41a4f1a87df6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG os_brick.utils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] <== get_connector_properties: return (219ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updating existing volume attachment record: b794a03f-cbe4-42e1-a572-15d884f5581f {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50dd444-2627-477f-845b-df0685aa3a2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:04:40 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:04:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7dc7b8-24b2-4cf0-9ed3-040b448e316a]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG os_brick.utils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] <== get_connector_properties: return (278ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:04:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Instance destroyed successfully.
Jul 25 10:04:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Attempting a stable device rescue
Jul 25 10:04:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71312) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 10:04:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Creating image(s)
Jul 25 10:04:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "/opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "/opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lazy-loading 'trusted_certs' on Instance uuid cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "73e7126e6fbd6d5ddba8dd839b823334ea8ef168" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "73e7126e6fbd6d5ddba8dd839b823334ea8ef168" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168.part --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:41 user nova-compute[71312]: DEBUG nova.virt.images [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] 48a15199-5272-4911-bc25-347604a4dc0b was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 10:04:41 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:04:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168.part /opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-cdaa9847-2401-484d-8815-1a6b040bfb68 req-a35f1652-02e1-4a9e-babf-7979e74d566e service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Received event network-changed-f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-cdaa9847-2401-484d-8815-1a6b040bfb68 req-a35f1652-02e1-4a9e-babf-7979e74d566e service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Refreshing instance network info cache due to event network-changed-f8b6315a-f86a-4616-97e3-647c1d6fdca7. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:04:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cdaa9847-2401-484d-8815-1a6b040bfb68 req-a35f1652-02e1-4a9e-babf-7979e74d566e service nova] Acquiring lock "refresh_cache-7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:04:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cdaa9847-2401-484d-8815-1a6b040bfb68 req-a35f1652-02e1-4a9e-babf-7979e74d566e service nova] Acquired lock "refresh_cache-7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:04:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-cdaa9847-2401-484d-8815-1a6b040bfb68 req-a35f1652-02e1-4a9e-babf-7979e74d566e service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Refreshing network info cache for port f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-8971f656-ac67-4567-aa9e-0bb2f8b88f0a req-ef986071-9b9b-47a8-acc0-f0e086e2889b service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8971f656-ac67-4567-aa9e-0bb2f8b88f0a req-ef986071-9b9b-47a8-acc0-f0e086e2889b service nova] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8971f656-ac67-4567-aa9e-0bb2f8b88f0a req-ef986071-9b9b-47a8-acc0-f0e086e2889b service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8971f656-ac67-4567-aa9e-0bb2f8b88f0a req-ef986071-9b9b-47a8-acc0-f0e086e2889b service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-8971f656-ac67-4567-aa9e-0bb2f8b88f0a req-ef986071-9b9b-47a8-acc0-f0e086e2889b service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] No waiting events found dispatching network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:04:42 user nova-compute[71312]: WARNING nova.compute.manager [req-8971f656-ac67-4567-aa9e-0bb2f8b88f0a req-ef986071-9b9b-47a8-acc0-f0e086e2889b service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received unexpected event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d for instance with vm_state active and task_state rescuing.
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168.part /opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168.converted" returned: 0 in 0.705s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:42 user nova-compute[71312]: INFO nova.compute.manager [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Terminating instance
Jul 25 10:04:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168.converted --force-share --output=json" returned: 0 in 0.291s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "73e7126e6fbd6d5ddba8dd839b823334ea8ef168" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.350s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "73e7126e6fbd6d5ddba8dd839b823334ea8ef168" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "73e7126e6fbd6d5ddba8dd839b823334ea8ef168" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168 --force-share --output=json" returned: 0 in 0.181s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168,backing_fmt=raw /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.rescue {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-cdaa9847-2401-484d-8815-1a6b040bfb68 req-a35f1652-02e1-4a9e-babf-7979e74d566e service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Updated VIF entry in instance network info cache for port f8b6315a-f86a-4616-97e3-647c1d6fdca7. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-cdaa9847-2401-484d-8815-1a6b040bfb68 req-a35f1652-02e1-4a9e-babf-7979e74d566e service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Updating instance_info_cache with network_info: [{"id": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "address": "fa:16:3e:55:18:b7", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b6315a-f8", "ovs_interfaceid": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168,backing_fmt=raw /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.rescue" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "73e7126e6fbd6d5ddba8dd839b823334ea8ef168" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lazy-loading 'migration_context' on Instance uuid cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cdaa9847-2401-484d-8815-1a6b040bfb68 req-a35f1652-02e1-4a9e-babf-7979e74d566e service nova] Releasing lock "refresh_cache-7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Start _get_guest_xml network_info=[{"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "vif_mac": "fa:16:3e:77:36:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '48a15199-5272-4911-bc25-347604a4dc0b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '4ba69046-43c6-491d-a433-69c981bb594a', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUxINHur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1', 'attached_at': '', 'detached_at': '', 'volume_id': '2616108b-d5a6-4bec-a913-8f7858013120', 'serial': '2616108b-d5a6-4bec-a913-8f7858013120'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lazy-loading 'resources' on Instance uuid cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lazy-loading 'numa_topology' on Instance uuid cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:43 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:04:43 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lazy-loading 'vcpu_model' on Instance uuid cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUxINHur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:43 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:43 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:43 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2681b8d9-a9da-4621-ae98-c660f144e3fd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kUxINHur\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 25 10:04:43 user nova-compute[71312]: node.name = iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120
Jul 25 10:04:43 user nova-compute[71312]: node.tpgt = -1
Jul 25 10:04:43 user nova-compute[71312]: node.startup = automatic
Jul 25 10:04:43 user nova-compute[71312]: node.leading_login = No
Jul 25 10:04:43 user nova-compute[71312]: iface.iscsi_ifacename = default
Jul 25 10:04:43 user nova-compute[71312]: iface.net_ifacename = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.ipaddress = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.prefix_len = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.hwaddress = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.transport_name = tcp
Jul 25 10:04:43 user nova-compute[71312]: iface.initiatorname = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.state = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.vlan_id = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.vlan_priority = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.vlan_state = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.iface_num = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.mtu = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.port = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.bootproto = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.subnet_mask = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.gateway = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.dhcp_alt_client_id_state = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.dhcp_alt_client_id = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.dhcp_dns = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.dhcp_learn_iqn = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.dhcp_req_vendor_id_state = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.dhcp_vendor_id_state = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.dhcp_vendor_id = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.dhcp_slp_da = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.fragmentation = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.gratuitous_arp = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.incoming_forwarding = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.tos_state = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.tos = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.ttl = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.delayed_ack = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.tcp_nagle = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.tcp_wsf_state = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.tcp_wsf = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.tcp_timer_scale = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.tcp_timestamp = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.redirect = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.def_task_mgmt_timeout = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.header_digest = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.data_digest = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.immediate_data = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.initial_r2t = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.data_seq_inorder = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.data_pdu_inorder = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.erl = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.max_receive_data_len = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.first_burst_len = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.max_outstanding_r2t = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.max_burst_len = 0
Jul 25 10:04:43 user nova-compute[71312]: iface.chap_auth = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.bidi_chap = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.strict_login_compliance = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.discovery_auth = <empty>
Jul 25 10:04:43 user nova-compute[71312]: iface.discovery_logout = <empty>
Jul 25 10:04:43 user nova-compute[71312]: node.discovery_address = <empty>
Jul 25 10:04:43 user nova-compute[71312]: node.discovery_port = 0
Jul 25 10:04:43 user nova-compute[71312]: node.discovery_type = static
Jul 25 10:04:43 user nova-compute[71312]: node.session.initial_cmdsn = 0
Jul 25 10:04:43 user nova-compute[71312]: node.session.initial_login_retry_max = 8
Jul 25 10:04:43 user nova-compute[71312]: node.session.xmit_thread_priority = -20
Jul 25 10:04:43 user nova-compute[71312]: node.session.cmds_max = 128
Jul 25 10:04:43 user nova-compute[71312]: node.session.queue_depth = 32
Jul 25 10:04:43 user nova-compute[71312]: node.session.nr_sessions = 1
Jul 25 10:04:43 user nova-compute[71312]: node.session.auth.authmethod = CHAP
Jul 25 10:04:43 user nova-compute[71312]: node.session.auth.username = kUxINHur
Jul 25 10:04:43 user nova-compute[71312]: node.session.auth.password = ***
Jul 25 10:04:43 user nova-compute[71312]: node.session.auth.username_in = <empty>
Jul 25 10:04:43 user nova-compute[71312]: node.session.auth.password_in = <empty>
Jul 25 10:04:43 user nova-compute[71312]: node.session.auth.chap_algs = MD5
Jul 25 10:04:43 user nova-compute[71312]: node.session.timeo.replacement_timeout = 120
Jul 25 10:04:43 user nova-compute[71312]: node.session.err_timeo.abort_timeout = 15
Jul 25 10:04:43 user nova-compute[71312]: node.session.err_timeo.lu_reset_timeout = 30
Jul 25 10:04:43 user nova-compute[71312]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 25 10:04:43 user nova-compute[71312]: node.session.err_timeo.host_reset_timeout = 60
Jul 25 10:04:43 user nova-compute[71312]: node.session.iscsi.FastAbort = Yes
Jul 25 10:04:43 user nova-compute[71312]: node.session.iscsi.InitialR2T = No
Jul 25 10:04:43 user nova-compute[71312]: node.session.iscsi.ImmediateData = Yes
Jul 25 10:04:43 user nova-compute[71312]: node.session.iscsi.FirstBurstLength = 262144
Jul 25 10:04:43 user nova-compute[71312]: node.session.iscsi.MaxBurstLength = 16776192
Jul 25 10:04:43 user nova-compute[71312]: node.session.iscsi.DefaultTime2Retain = 0
Jul 25 10:04:43 user nova-compute[71312]: node.session.iscsi.DefaultTime2Wait = 2
Jul 25 10:04:43 user nova-compute[71312]: node.session.iscsi.MaxConnections = 1
Jul 25 10:04:43 user nova-compute[71312]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 25 10:04:43 user nova-compute[71312]: node.session.iscsi.ERL = 0
Jul 25 10:04:43 user nova-compute[71312]: node.session.scan = manual
Jul 25 10:04:43 user nova-compute[71312]: node.session.reopen_max = 0
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].address = 172.16.0.220
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].port = 3260
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].startup = manual
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].tcp.window_size = 524288
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].tcp.type_of_service = 0
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].timeo.logout_timeout = 15
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].timeo.login_timeout = 15
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].timeo.auth_timeout = 45
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].timeo.noop_out_interval = 5
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].timeo.noop_out_timeout = 5
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].iscsi.HeaderDigest = None
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].iscsi.DataDigest = None
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].iscsi.IFMarker = No
Jul 25 10:04:43 user nova-compute[71312]: node.conn[0].iscsi.OFMarker = No
Jul 25 10:04:43 user nova-compute[71312]: # END RECORD
Jul 25 10:04:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.158s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6398822-e179-49d4-9a02-6fff997817b3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d113e1d0-06e5-4b6c-9e07-b8ccce2a020f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUxINHur {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUxINHur" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9088f838-0237-450f-85b9-bffe57861ac3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kUxINHur'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Instance destroyed successfully.
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'resources' on Instance uuid 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[284d8d8e-e4eb-409e-83b8-58bbbd4968d3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-815665361',display_name='tempest-AttachVolumeNegativeTest-server-815665361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-815665361',id=12,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIb5nxWzSLVfQqLVyGp2qTyDyfZG1UBm0cAeYpLivZSEi8qg9ZvhfaN+ekQILTgjvZvGXCZLbQOhOeYBsQSXOm5DyX2MQNBaYkwlqhd8UQs9sWy/MwW979NkgJtQ0X6Og==',key_name='tempest-keypair-37618991',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:02:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a09fcc394c945c2b843abf3df53cda6',ramdisk_id='',reservation_id='r-yl0b5ckj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1016049404',owner_user_name='tempest-AttachVolumeNegativeTest-1016049404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe1a69013de4b4dbcb98a35e48d8ee8',uuid=7c1d967c-cb20-4204-a0aa-d9ec4ecde09e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "address": "fa:16:3e:55:18:b7", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b6315a-f8", "ovs_interfaceid": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converting VIF {"id": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "address": "fa:16:3e:55:18:b7", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b6315a-f8", "ovs_interfaceid": "f8b6315a-f86a-4616-97e3-647c1d6fdca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:18:b7,bridge_name='br-int',has_traffic_filtering=True,id=f8b6315a-f86a-4616-97e3-647c1d6fdca7,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b6315a-f8') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_vif [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:18:b7,bridge_name='br-int',has_traffic_filtering=True,id=f8b6315a-f86a-4616-97e3-647c1d6fdca7,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b6315a-f8') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8b6315a-f8, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2017ae-0dce-48af-b9a4-dccc0d4c1fc3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:43 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:43 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:04:43 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:43 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:43 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:04:43 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] HCTL ('34', '0', '0', 0) found on session 15 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:43 user nova-compute[71312]: INFO os_vif [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:18:b7,bridge_name='br-int',has_traffic_filtering=True,id=f8b6315a-f86a-4616-97e3-647c1d6fdca7,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b6315a-f8')
Jul 25 10:04:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Deleting instance files /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e_del
Jul 25 10:04:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Deletion of /opt/stack/data/nova/instances/7c1d967c-cb20-4204-a0aa-d9ec4ecde09e_del complete
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fcfe87-fa8a-423d-9cd9-cb9b68908457]: (4, ('0 0 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Searching for a device in session 15 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUxINHur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.352s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] <== connect_volume: return (353ms) {'type': 'block', 'scsi_wwn': '23865356131363033', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865356131363033', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-154077661',display_name='tempest-ServerStableDeviceRescueTest-server-154077661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-154077661',id=7,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5DPaESDCeTpFbLJiK3piM5EU6CqyhywiQ6G6M7018kXvUoCeKIYBjx8qywJTsbdrwNXxHLDnFEpNN/Njz3QJ803HXAV1pUHCs8Upben7DXi3URXH+EDpuvsOogdBIbWA==',key_name='tempest-keypair-2033571811',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dda42819655247c4bd852a6e41edeb69',ramdisk_id='',reservation_id='r-vhaos4q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-430984902',owner_user_name='tempest-ServerStableDeviceRescueTest-430984902-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e2c8d915c3f4fdd8056f8b8651a6b79',uuid=cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "vif_mac": "fa:16:3e:77:36:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Converting VIF {"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "vif_mac": "fa:16:3e:77:36:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:36:b8,bridge_name='br-int',has_traffic_filtering=True,id=63f89ec1-70e3-4e23-ad25-c0f935da374d,network=Network(ec35bc41-dfd0-49c6-a731-3d750841e2b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f89ec1-70') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lazy-loading 'pci_devices' on Instance uuid cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:04:43 user nova-compute[71312]:   <uuid>cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1</uuid>
Jul 25 10:04:43 user nova-compute[71312]:   <name>instance-00000007</name>
Jul 25 10:04:43 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:04:43 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:04:43 user nova-compute[71312]:   <metadata>
Jul 25 10:04:43 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:04:43 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:04:43 user nova-compute[71312]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-154077661</nova:name>
Jul 25 10:04:43 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:04:43</nova:creationTime>
Jul 25 10:04:43 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:04:43 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:04:43 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:04:43 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:04:43 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:04:43 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:04:43 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:04:43 user nova-compute[71312]:       <nova:owner>
Jul 25 10:04:43 user nova-compute[71312]:         <nova:user uuid="9e2c8d915c3f4fdd8056f8b8651a6b79">tempest-ServerStableDeviceRescueTest-430984902-project-member</nova:user>
Jul 25 10:04:43 user nova-compute[71312]:         <nova:project uuid="dda42819655247c4bd852a6e41edeb69">tempest-ServerStableDeviceRescueTest-430984902</nova:project>
Jul 25 10:04:43 user nova-compute[71312]:       </nova:owner>
Jul 25 10:04:43 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:04:43 user nova-compute[71312]:       <nova:ports>
Jul 25 10:04:43 user nova-compute[71312]:         <nova:port uuid="63f89ec1-70e3-4e23-ad25-c0f935da374d">
Jul 25 10:04:43 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 10:04:43 user nova-compute[71312]:         </nova:port>
Jul 25 10:04:43 user nova-compute[71312]:       </nova:ports>
Jul 25 10:04:43 user nova-compute[71312]:     </nova:instance>
Jul 25 10:04:43 user nova-compute[71312]:   </metadata>
Jul 25 10:04:43 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:04:43 user nova-compute[71312]:     <system>
Jul 25 10:04:43 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:04:43 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:04:43 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:04:43 user nova-compute[71312]:       <entry name="serial">cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1</entry>
Jul 25 10:04:43 user nova-compute[71312]:       <entry name="uuid">cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1</entry>
Jul 25 10:04:43 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:04:43 user nova-compute[71312]:     </system>
Jul 25 10:04:43 user nova-compute[71312]:   </sysinfo>
Jul 25 10:04:43 user nova-compute[71312]:   <os>
Jul 25 10:04:43 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:04:43 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:04:43 user nova-compute[71312]:   </os>
Jul 25 10:04:43 user nova-compute[71312]:   <features>
Jul 25 10:04:43 user nova-compute[71312]:     <acpi/>
Jul 25 10:04:43 user nova-compute[71312]:     <apic/>
Jul 25 10:04:43 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:04:43 user nova-compute[71312]:   </features>
Jul 25 10:04:43 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:04:43 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:04:43 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:04:43 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:04:43 user nova-compute[71312]:   </clock>
Jul 25 10:04:43 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:04:43 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:04:43 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:04:43 user nova-compute[71312]:   </cpu>
Jul 25 10:04:43 user nova-compute[71312]:   <devices>
Jul 25 10:04:43 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:04:43 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:04:43 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk"/>
Jul 25 10:04:43 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:04:43 user nova-compute[71312]:     </disk>
Jul 25 10:04:43 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:04:43 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:04:43 user nova-compute[71312]:       <source dev="/dev/sdc"/>
Jul 25 10:04:43 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Jul 25 10:04:43 user nova-compute[71312]:       <serial>2616108b-d5a6-4bec-a913-8f7858013120</serial>
Jul 25 10:04:43 user nova-compute[71312]:     </disk>
Jul 25 10:04:43 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:04:43 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:04:43 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.rescue"/>
Jul 25 10:04:43 user nova-compute[71312]:       <target dev="vdc" bus="virtio"/>
Jul 25 10:04:43 user nova-compute[71312]:       <boot order="1"/>
Jul 25 10:04:43 user nova-compute[71312]:     </disk>
Jul 25 10:04:43 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:04:43 user nova-compute[71312]:       <mac address="fa:16:3e:77:36:b8"/>
Jul 25 10:04:43 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:04:43 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:04:43 user nova-compute[71312]:       <target dev="tap63f89ec1-70"/>
Jul 25 10:04:43 user nova-compute[71312]:     </interface>
Jul 25 10:04:43 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:04:43 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/console.log" append="off"/>
Jul 25 10:04:43 user nova-compute[71312]:     </serial>
Jul 25 10:04:43 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:04:43 user nova-compute[71312]:     <video>
Jul 25 10:04:43 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:04:43 user nova-compute[71312]:     </video>
Jul 25 10:04:43 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:04:43 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:04:43 user nova-compute[71312]:     </rng>
Jul 25 10:04:43 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:04:43 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:04:43 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:04:43 user nova-compute[71312]:     </memballoon>
Jul 25 10:04:43 user nova-compute[71312]:   </devices>
Jul 25 10:04:43 user nova-compute[71312]: </domain>
Jul 25 10:04:43 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:04:43 user nova-compute[71312]: INFO nova.compute.manager [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Took 1.04 seconds to destroy the instance on the hypervisor.
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:04:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Instance destroyed successfully.
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] No VIF found with MAC fa:16:3e:77:36:b8, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-989c9299-c47f-4cc3-b432-c8f87e859ccc req-beadde0f-bd49-40c8-9787-6a4653980633 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Received event network-vif-unplugged-f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-989c9299-c47f-4cc3-b432-c8f87e859ccc req-beadde0f-bd49-40c8-9787-6a4653980633 service nova] Acquiring lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-989c9299-c47f-4cc3-b432-c8f87e859ccc req-beadde0f-bd49-40c8-9787-6a4653980633 service nova] Lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-989c9299-c47f-4cc3-b432-c8f87e859ccc req-beadde0f-bd49-40c8-9787-6a4653980633 service nova] Lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-989c9299-c47f-4cc3-b432-c8f87e859ccc req-beadde0f-bd49-40c8-9787-6a4653980633 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] No waiting events found dispatching network-vif-unplugged-f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-989c9299-c47f-4cc3-b432-c8f87e859ccc req-beadde0f-bd49-40c8-9787-6a4653980633 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Received event network-vif-unplugged-f8b6315a-f86a-4616-97e3-647c1d6fdca7 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-989c9299-c47f-4cc3-b432-c8f87e859ccc req-beadde0f-bd49-40c8-9787-6a4653980633 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Received event network-vif-plugged-f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-989c9299-c47f-4cc3-b432-c8f87e859ccc req-beadde0f-bd49-40c8-9787-6a4653980633 service nova] Acquiring lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-989c9299-c47f-4cc3-b432-c8f87e859ccc req-beadde0f-bd49-40c8-9787-6a4653980633 service nova] Lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-989c9299-c47f-4cc3-b432-c8f87e859ccc req-beadde0f-bd49-40c8-9787-6a4653980633 service nova] Lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-989c9299-c47f-4cc3-b432-c8f87e859ccc req-beadde0f-bd49-40c8-9787-6a4653980633 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] No waiting events found dispatching network-vif-plugged-f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:04:43 user nova-compute[71312]: WARNING nova.compute.manager [req-989c9299-c47f-4cc3-b432-c8f87e859ccc req-beadde0f-bd49-40c8-9787-6a4653980633 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Received unexpected event network-vif-plugged-f8b6315a-f86a-4616-97e3-647c1d6fdca7 for instance with vm_state active and task_state deleting.
Jul 25 10:04:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:44 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:04:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-130733a5-45ef-44a2-953c-894eadf60df7 req-1d0e1bf6-5cf6-4caf-b57b-db4b69a56218 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Received event network-vif-deleted-f8b6315a-f86a-4616-97e3-647c1d6fdca7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:44 user nova-compute[71312]: INFO nova.compute.manager [req-130733a5-45ef-44a2-953c-894eadf60df7 req-1d0e1bf6-5cf6-4caf-b57b-db4b69a56218 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Neutron deleted interface f8b6315a-f86a-4616-97e3-647c1d6fdca7; detaching it from the instance and deleting it from the info cache
Jul 25 10:04:44 user nova-compute[71312]: DEBUG nova.network.neutron [req-130733a5-45ef-44a2-953c-894eadf60df7 req-1d0e1bf6-5cf6-4caf-b57b-db4b69a56218 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:04:44 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Took 1.24 seconds to deallocate network for instance.
Jul 25 10:04:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-130733a5-45ef-44a2-953c-894eadf60df7 req-1d0e1bf6-5cf6-4caf-b57b-db4b69a56218 service nova] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Detach interface failed, port_id=f8b6315a-f86a-4616-97e3-647c1d6fdca7, reason: Instance 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:04:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:45 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:04:45 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:04:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.627s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:46 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Deleted allocations for instance 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e
Jul 25 10:04:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f33a49c1-d1dd-4e89-99fe-f180d8435653 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "7c1d967c-cb20-4204-a0aa-d9ec4ecde09e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.610s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-15be9bc6-1aa7-4d69-bf41-1b816ccd0dd9 req-328d7195-60cc-4227-9322-f7fb7f4fb163 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15be9bc6-1aa7-4d69-bf41-1b816ccd0dd9 req-328d7195-60cc-4227-9322-f7fb7f4fb163 service nova] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15be9bc6-1aa7-4d69-bf41-1b816ccd0dd9 req-328d7195-60cc-4227-9322-f7fb7f4fb163 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15be9bc6-1aa7-4d69-bf41-1b816ccd0dd9 req-328d7195-60cc-4227-9322-f7fb7f4fb163 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-15be9bc6-1aa7-4d69-bf41-1b816ccd0dd9 req-328d7195-60cc-4227-9322-f7fb7f4fb163 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] No waiting events found dispatching network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:04:46 user nova-compute[71312]: WARNING nova.compute.manager [req-15be9bc6-1aa7-4d69-bf41-1b816ccd0dd9 req-328d7195-60cc-4227-9322-f7fb7f4fb163 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received unexpected event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d for instance with vm_state active and task_state rescuing.
Jul 25 10:04:47 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279472.4963527, 9fb85501-6210-4bfd-b496-1891c79fd23c => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:04:47 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] VM Stopped (Lifecycle Event)
Jul 25 10:04:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-34490ab7-8873-4a96-a0cd-8c3d0d7c0102 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:04:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-34490ab7-8873-4a96-a0cd-8c3d0d7c0102 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:04:47 user nova-compute[71312]: INFO nova.compute.manager [None req-34490ab7-8873-4a96-a0cd-8c3d0d7c0102 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 25 10:04:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Removed pending event for cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 10:04:48 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279488.246022, cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:04:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] VM Resumed (Lifecycle Event)
Jul 25 10:04:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4a52d115-f5d3-4caa-871f-17031fc45fe9 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:04:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:04:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:04:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 10:04:48 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279488.2489603, cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:04:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] VM Started (Lifecycle Event)
Jul 25 10:04:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:04:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:04:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-bdc6f396-a352-49d1-8184-89f8a072cfb9 req-665d0fc3-b895-4623-a9d2-11bab6d65ef9 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:04:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdc6f396-a352-49d1-8184-89f8a072cfb9 req-665d0fc3-b895-4623-a9d2-11bab6d65ef9 service nova] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdc6f396-a352-49d1-8184-89f8a072cfb9 req-665d0fc3-b895-4623-a9d2-11bab6d65ef9 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdc6f396-a352-49d1-8184-89f8a072cfb9 req-665d0fc3-b895-4623-a9d2-11bab6d65ef9 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-bdc6f396-a352-49d1-8184-89f8a072cfb9 req-665d0fc3-b895-4623-a9d2-11bab6d65ef9 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] No waiting events found dispatching network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:04:49 user nova-compute[71312]: WARNING nova.compute.manager [req-bdc6f396-a352-49d1-8184-89f8a072cfb9 req-665d0fc3-b895-4623-a9d2-11bab6d65ef9 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received unexpected event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d for instance with vm_state rescued and task_state None.
Jul 25 10:04:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:51 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279476.3011553, bcc93774-32b0-4592-bf6a-d655bac21d39 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:04:51 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] VM Stopped (Lifecycle Event)
Jul 25 10:04:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c27d7a88-0ce7-4180-896b-f9612a6b5c7c None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:04:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Starting finish_migration {{(pid=71312) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 10:04:58 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Creating image(s)
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.objects.instance [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.209s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk. size=21474836480 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279483.4225028, 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:04:58 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] VM Stopped (Lifecycle Event)
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3d0770bc-2fdf-49ee-a735-5d776bc6a9e4 None None] [instance: 7c1d967c-cb20-4204-a0aa-d9ec4ecde09e] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:04:58 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Creating image(s)
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "/opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "/opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk 21474836480 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk 21474836480" returned: 0 in 0.072s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.161s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Ensure instance console log exists: /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Start _get_guest_xml network_info=[{"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1712941866-network", "vif_mac": "fa:16:3e:60:72:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '73bd5111-cd5b-4b97-a7d4-48747549bad7', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgKmjAwp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9fb85501-6210-4bfd-b496-1891c79fd23c', 'attached_at': '2023-07-25T10:04:58.000000', 'detached_at': '', 'volume_id': 'e3bd4850-4e1c-4068-b953-75f6c4c360ac', 'serial': 'e3bd4850-4e1c-4068-b953-75f6c4c360ac'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:04:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:04:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.objects.instance [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgKmjAwp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:58 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:04:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:58 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:04:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:04:58 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.163s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a3c95e-6c30-4b69-809d-a0b5e3a3dbf6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:04:58 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk 1073741824" returned: 0 in 0.055s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9964e2e-6977-4b53-b9ac-1d8e39da3e37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac] added
Jul 25 10:04:58 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[964069df-2169-4487-aa4b-e1dcaef6f8b7]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5746c4ba-b696-4fb9-8bee-b5d1e25b86f8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgKmjAwp {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgKmjAwp" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[474b872d-6212-41e3-909e-ac14603348bd]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IgKmjAwp'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.162s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b8e9d1-4b7f-4c6c-b9a2-7225e8c13347]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00bdef0-388a-4c8a-8595-462139715c06]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Cannot resize image /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Ensure instance console log exists: /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Start _get_guest_xml network_info=[{"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'b794a03f-cbe4-42e1-a572-15d884f5581f', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEIBehbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bcc93774-32b0-4592-bf6a-d655bac21d39', 'attached_at': '', 'detached_at': '', 'volume_id': '9bca412d-abf2-4775-898b-4dc48badc670', 'serial': '9bca412d-abf2-4775-898b-4dc48badc670'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca231c8-1a1e-43e2-82a6-25905ff3d631]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260]
Jul 25 10:04:59 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260] successful.
Jul 25 10:04:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:59 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 25 10:04:59 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'vcpu_model' on Instance uuid bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f7f6ef-f7df-45b1-be0a-85f3ed271134]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEIBehbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:04:59 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce99523a-fb2a-4ed1-b5fc-499fafc55f4a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:59 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:04:59 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:04:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.479s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c861dc8-bb2b-4417-afa0-5c25d2d80fac]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:04:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgKmjAwp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.526s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] <== connect_volume: return (1527ms) {'type': 'block', 'scsi_wwn': '23236323063383638', 'path': '/dev/sde'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236323063383638', 'path': '/dev/sde'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.059s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:05:00 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:05:00 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704266463',display_name='tempest-ServerActionsTestOtherB-server-704266463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704266463',id=4,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeo1OyzMR1FuY3t9bxVf78EYsomUcs1GBJeQZ+xHk7Q6n7Ea0otdZoq9Stbi9efTSjxNpLsJBFIquobgg119YA0SZsVMkFCxXfGhMNAahmBkXlggOo2Y7cPMghqdLy6UQ==',key_name='tempest-keypair-1722521166',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='39ace30139b94322bdc7a657d3546757',ramdisk_id='',reservation_id='r-x9ogqxil',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-766110382',owner_user_name='tempest-ServerActionsTestOtherB-766110382-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:04:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5186cf6b19094cb2948a2d4f966f3dcc',uuid=9fb85501-6210-4bfd-b496-1891c79fd23c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1712941866-network", "vif_mac": "fa:16:3e:60:72:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converting VIF {"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1712941866-network", "vif_mac": "fa:16:3e:60:72:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:05:00 user nova-compute[71312]:   <uuid>9fb85501-6210-4bfd-b496-1891c79fd23c</uuid>
Jul 25 10:05:00 user nova-compute[71312]:   <name>instance-00000004</name>
Jul 25 10:05:00 user nova-compute[71312]:   <memory>2097152</memory>
Jul 25 10:05:00 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:05:00 user nova-compute[71312]:   <metadata>
Jul 25 10:05:00 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:05:00 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:05:00 user nova-compute[71312]:       <nova:name>tempest-ServerActionsTestOtherB-server-704266463</nova:name>
Jul 25 10:05:00 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:04:58</nova:creationTime>
Jul 25 10:05:00 user nova-compute[71312]:       <nova:flavor name="m1.small">
Jul 25 10:05:00 user nova-compute[71312]:         <nova:memory>2048</nova:memory>
Jul 25 10:05:00 user nova-compute[71312]:         <nova:disk>20</nova:disk>
Jul 25 10:05:00 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:05:00 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:05:00 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:05:00 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:05:00 user nova-compute[71312]:       <nova:owner>
Jul 25 10:05:00 user nova-compute[71312]:         <nova:user uuid="5186cf6b19094cb2948a2d4f966f3dcc">tempest-ServerActionsTestOtherB-766110382-project-member</nova:user>
Jul 25 10:05:00 user nova-compute[71312]:         <nova:project uuid="39ace30139b94322bdc7a657d3546757">tempest-ServerActionsTestOtherB-766110382</nova:project>
Jul 25 10:05:00 user nova-compute[71312]:       </nova:owner>
Jul 25 10:05:00 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:05:00 user nova-compute[71312]:       <nova:ports>
Jul 25 10:05:00 user nova-compute[71312]:         <nova:port uuid="8727a126-c33f-4868-8651-45e7c1f663d2">
Jul 25 10:05:00 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:05:00 user nova-compute[71312]:         </nova:port>
Jul 25 10:05:00 user nova-compute[71312]:       </nova:ports>
Jul 25 10:05:00 user nova-compute[71312]:     </nova:instance>
Jul 25 10:05:00 user nova-compute[71312]:   </metadata>
Jul 25 10:05:00 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:05:00 user nova-compute[71312]:     <system>
Jul 25 10:05:00 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:05:00 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:05:00 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:05:00 user nova-compute[71312]:       <entry name="serial">9fb85501-6210-4bfd-b496-1891c79fd23c</entry>
Jul 25 10:05:00 user nova-compute[71312]:       <entry name="uuid">9fb85501-6210-4bfd-b496-1891c79fd23c</entry>
Jul 25 10:05:00 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:05:00 user nova-compute[71312]:     </system>
Jul 25 10:05:00 user nova-compute[71312]:   </sysinfo>
Jul 25 10:05:00 user nova-compute[71312]:   <os>
Jul 25 10:05:00 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:05:00 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:05:00 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:05:00 user nova-compute[71312]:   </os>
Jul 25 10:05:00 user nova-compute[71312]:   <features>
Jul 25 10:05:00 user nova-compute[71312]:     <acpi/>
Jul 25 10:05:00 user nova-compute[71312]:     <apic/>
Jul 25 10:05:00 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:05:00 user nova-compute[71312]:   </features>
Jul 25 10:05:00 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:05:00 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:05:00 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:05:00 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:05:00 user nova-compute[71312]:   </clock>
Jul 25 10:05:00 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:05:00 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:05:00 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:05:00 user nova-compute[71312]:   </cpu>
Jul 25 10:05:00 user nova-compute[71312]:   <devices>
Jul 25 10:05:00 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:05:00 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:05:00 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk"/>
Jul 25 10:05:00 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:05:00 user nova-compute[71312]:     </disk>
Jul 25 10:05:00 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:05:00 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:05:00 user nova-compute[71312]:       <source dev="/dev/sde"/>
Jul 25 10:05:00 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Jul 25 10:05:00 user nova-compute[71312]:       <serial>e3bd4850-4e1c-4068-b953-75f6c4c360ac</serial>
Jul 25 10:05:00 user nova-compute[71312]:     </disk>
Jul 25 10:05:00 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:05:00 user nova-compute[71312]:       <mac address="fa:16:3e:60:72:df"/>
Jul 25 10:05:00 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:05:00 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:05:00 user nova-compute[71312]:       <target dev="tap8727a126-c3"/>
Jul 25 10:05:00 user nova-compute[71312]:     </interface>
Jul 25 10:05:00 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:05:00 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/console.log" append="off"/>
Jul 25 10:05:00 user nova-compute[71312]:     </serial>
Jul 25 10:05:00 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:05:00 user nova-compute[71312]:     <video>
Jul 25 10:05:00 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:05:00 user nova-compute[71312]:     </video>
Jul 25 10:05:00 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:05:00 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:05:00 user nova-compute[71312]:     </rng>
Jul 25 10:05:00 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:05:00 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:05:00 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:05:00 user nova-compute[71312]:     </memballoon>
Jul 25 10:05:00 user nova-compute[71312]:   </devices>
Jul 25 10:05:00 user nova-compute[71312]: </domain>
Jul 25 10:05:00 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704266463',display_name='tempest-ServerActionsTestOtherB-server-704266463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704266463',id=4,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeo1OyzMR1FuY3t9bxVf78EYsomUcs1GBJeQZ+xHk7Q6n7Ea0otdZoq9Stbi9efTSjxNpLsJBFIquobgg119YA0SZsVMkFCxXfGhMNAahmBkXlggOo2Y7cPMghqdLy6UQ==',key_name='tempest-keypair-1722521166',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='39ace30139b94322bdc7a657d3546757',ramdisk_id='',reservation_id='r-x9ogqxil',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-766110382',owner_user_name='tempest-ServerActionsTestOtherB-766110382-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:04:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5186cf6b19094cb2948a2d4f966f3dcc',uuid=9fb85501-6210-4bfd-b496-1891c79fd23c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1712941866-network", "vif_mac": "fa:16:3e:60:72:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converting VIF {"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1712941866-network", "vif_mac": "fa:16:3e:60:72:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_vif [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260" returned: 21 in 0.044s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5047fa-adbd-4309-80f5-3d829f295132]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:05:00 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8727a126-c3, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8727a126-c3, col_values=(('external_ids', {'iface-id': '8727a126-c33f-4868-8651-45e7c1f663d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:72:df', 'vm-uuid': '9fb85501-6210-4bfd-b496-1891c79fd23c'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:00 user nova-compute[71312]: INFO os_vif [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3')
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[76376dd5-96e8-4f80-9b69-ef786db475a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670] added
Jul 25 10:05:00 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c6c3de-b4c5-4a65-a9ab-7b6d893944a8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[869df818-0477-487a-8724-9d7c625a4df6]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pEIBehbX {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] No VIF found with MAC fa:16:3e:60:72:df, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pEIBehbX" returned: 0 in 0.033s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f072e54-b475-4e05-a243-b2830707b9fe]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pEIBehbX'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3595840f-0c89-45d4-b16d-12b1c666acd4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b87ddc0-cdae-4d2f-bfe1-c845de7f7d1f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bbd32f-3bf4-4652-8193-f3ec3854341a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260]
Jul 25 10:05:00 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260] successful.
Jul 25 10:05:00 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2d2c7e-4870-46d4-80a1-167f842d8677]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c81599-9944-4f98-844c-a50e2e9684cf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:05:00 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.469s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] HCTL ('38', '-', '-', 0) found on session 17 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0636d762-a16d-4d7d-bdb0-2c288be64202]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:00 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEIBehbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.510s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] <== connect_volume: return (2569ms) {'type': 'block', 'scsi_wwn': '23137326332363035', 'path': '/dev/sdg'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137326332363035', 'path': '/dev/sdg'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-164940161',display_name='tempest-ServerActionsTestOtherA-server-1344752152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-164940161',id=5,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7/PiN27E1zNONLGfU75gjTzl6TjLJTSPguo/w/NLGiNWvcFBQAXJk/RsZr2x3/TDzaN8UL9NG26qh75+qbwT35akc6FqjZaWZn3poJMiar+SGmPPXZDxAQP/CqYmNQIw==',key_name='tempest-keypair-2143034637',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c30d33a1a8945fdab6798c94a558444',ramdisk_id='',reservation_id='r-rxkl8cmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-408585031',owner_user_name='tempest-ServerActionsTestOtherA-408585031-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfdced66e34e0ba7f9437e71aaee6a',uuid=bcc93774-32b0-4592-bf6a-d655bac21d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converting VIF {"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=d1cb436a-ed84-43ea-a32f-6c08effc60d6,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb436a-ed') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:05:01 user nova-compute[71312]:   <uuid>bcc93774-32b0-4592-bf6a-d655bac21d39</uuid>
Jul 25 10:05:01 user nova-compute[71312]:   <name>instance-00000005</name>
Jul 25 10:05:01 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:05:01 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:05:01 user nova-compute[71312]:   <metadata>
Jul 25 10:05:01 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:05:01 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:05:01 user nova-compute[71312]:       <nova:name>tempest-ServerActionsTestOtherA-server-1344752152</nova:name>
Jul 25 10:05:01 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:04:59</nova:creationTime>
Jul 25 10:05:01 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:05:01 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:05:01 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:05:01 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:05:01 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:05:01 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:05:01 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:05:01 user nova-compute[71312]:       <nova:owner>
Jul 25 10:05:01 user nova-compute[71312]:         <nova:user uuid="c2cfdced66e34e0ba7f9437e71aaee6a">tempest-ServerActionsTestOtherA-408585031-project-member</nova:user>
Jul 25 10:05:01 user nova-compute[71312]:         <nova:project uuid="9c30d33a1a8945fdab6798c94a558444">tempest-ServerActionsTestOtherA-408585031</nova:project>
Jul 25 10:05:01 user nova-compute[71312]:       </nova:owner>
Jul 25 10:05:01 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:05:01 user nova-compute[71312]:       <nova:ports>
Jul 25 10:05:01 user nova-compute[71312]:         <nova:port uuid="d1cb436a-ed84-43ea-a32f-6c08effc60d6">
Jul 25 10:05:01 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 10:05:01 user nova-compute[71312]:         </nova:port>
Jul 25 10:05:01 user nova-compute[71312]:       </nova:ports>
Jul 25 10:05:01 user nova-compute[71312]:     </nova:instance>
Jul 25 10:05:01 user nova-compute[71312]:   </metadata>
Jul 25 10:05:01 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:05:01 user nova-compute[71312]:     <system>
Jul 25 10:05:01 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:05:01 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:05:01 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:05:01 user nova-compute[71312]:       <entry name="serial">bcc93774-32b0-4592-bf6a-d655bac21d39</entry>
Jul 25 10:05:01 user nova-compute[71312]:       <entry name="uuid">bcc93774-32b0-4592-bf6a-d655bac21d39</entry>
Jul 25 10:05:01 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:05:01 user nova-compute[71312]:     </system>
Jul 25 10:05:01 user nova-compute[71312]:   </sysinfo>
Jul 25 10:05:01 user nova-compute[71312]:   <os>
Jul 25 10:05:01 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:05:01 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:05:01 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:05:01 user nova-compute[71312]:   </os>
Jul 25 10:05:01 user nova-compute[71312]:   <features>
Jul 25 10:05:01 user nova-compute[71312]:     <acpi/>
Jul 25 10:05:01 user nova-compute[71312]:     <apic/>
Jul 25 10:05:01 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:05:01 user nova-compute[71312]:   </features>
Jul 25 10:05:01 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:05:01 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:05:01 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:05:01 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:05:01 user nova-compute[71312]:   </clock>
Jul 25 10:05:01 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:05:01 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:05:01 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:05:01 user nova-compute[71312]:   </cpu>
Jul 25 10:05:01 user nova-compute[71312]:   <devices>
Jul 25 10:05:01 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:05:01 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:05:01 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk"/>
Jul 25 10:05:01 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:05:01 user nova-compute[71312]:     </disk>
Jul 25 10:05:01 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:05:01 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:05:01 user nova-compute[71312]:       <source dev="/dev/sdg"/>
Jul 25 10:05:01 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Jul 25 10:05:01 user nova-compute[71312]:       <serial>9bca412d-abf2-4775-898b-4dc48badc670</serial>
Jul 25 10:05:01 user nova-compute[71312]:     </disk>
Jul 25 10:05:01 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:05:01 user nova-compute[71312]:       <mac address="fa:16:3e:e9:8e:2b"/>
Jul 25 10:05:01 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:05:01 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:05:01 user nova-compute[71312]:       <target dev="tapd1cb436a-ed"/>
Jul 25 10:05:01 user nova-compute[71312]:     </interface>
Jul 25 10:05:01 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:05:01 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/console.log" append="off"/>
Jul 25 10:05:01 user nova-compute[71312]:     </serial>
Jul 25 10:05:01 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:05:01 user nova-compute[71312]:     <video>
Jul 25 10:05:01 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:05:01 user nova-compute[71312]:     </video>
Jul 25 10:05:01 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:05:01 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:05:01 user nova-compute[71312]:     </rng>
Jul 25 10:05:01 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:05:01 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:05:01 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:05:01 user nova-compute[71312]:     </memballoon>
Jul 25 10:05:01 user nova-compute[71312]:   </devices>
Jul 25 10:05:01 user nova-compute[71312]: </domain>
Jul 25 10:05:01 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-164940161',display_name='tempest-ServerActionsTestOtherA-server-1344752152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-164940161',id=5,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7/PiN27E1zNONLGfU75gjTzl6TjLJTSPguo/w/NLGiNWvcFBQAXJk/RsZr2x3/TDzaN8UL9NG26qh75+qbwT35akc6FqjZaWZn3poJMiar+SGmPPXZDxAQP/CqYmNQIw==',key_name='tempest-keypair-2143034637',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c30d33a1a8945fdab6798c94a558444',ramdisk_id='',reservation_id='r-rxkl8cmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-408585031',owner_user_name='tempest-ServerActionsTestOtherA-408585031-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfdced66e34e0ba7f9437e71aaee6a',uuid=bcc93774-32b0-4592-bf6a-d655bac21d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converting VIF {"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=d1cb436a-ed84-43ea-a32f-6c08effc60d6,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb436a-ed') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG os_vif [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=d1cb436a-ed84-43ea-a32f-6c08effc60d6,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb436a-ed') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1cb436a-ed, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1cb436a-ed, col_values=(('external_ids', {'iface-id': 'd1cb436a-ed84-43ea-a32f-6c08effc60d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:8e:2b', 'vm-uuid': 'bcc93774-32b0-4592-bf6a-d655bac21d39'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:05:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:05:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:02 user nova-compute[71312]: INFO os_vif [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=d1cb436a-ed84-43ea-a32f-6c08effc60d6,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb436a-ed')
Jul 25 10:05:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:05:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:05:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] No VIF found with MAC fa:16:3e:e9:8e:2b, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:05:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-79a08fda-2898-451d-80a8-283ab16c92ce req-a50bc61a-e6f7-40f2-b566-529386789926 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-79a08fda-2898-451d-80a8-283ab16c92ce req-a50bc61a-e6f7-40f2-b566-529386789926 service nova] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-79a08fda-2898-451d-80a8-283ab16c92ce req-a50bc61a-e6f7-40f2-b566-529386789926 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-79a08fda-2898-451d-80a8-283ab16c92ce req-a50bc61a-e6f7-40f2-b566-529386789926 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-79a08fda-2898-451d-80a8-283ab16c92ce req-a50bc61a-e6f7-40f2-b566-529386789926 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] No waiting events found dispatching network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:05:02 user nova-compute[71312]: WARNING nova.compute.manager [req-79a08fda-2898-451d-80a8-283ab16c92ce req-a50bc61a-e6f7-40f2-b566-529386789926 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received unexpected event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 for instance with vm_state active and task_state resize_finish.
Jul 25 10:05:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-62d30e54-2f21-468e-9901-455cd3b63c94 req-fa647405-d1b1-4b27-858f-5c956417a700 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-62d30e54-2f21-468e-9901-455cd3b63c94 req-fa647405-d1b1-4b27-858f-5c956417a700 service nova] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-62d30e54-2f21-468e-9901-455cd3b63c94 req-fa647405-d1b1-4b27-858f-5c956417a700 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-62d30e54-2f21-468e-9901-455cd3b63c94 req-fa647405-d1b1-4b27-858f-5c956417a700 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-62d30e54-2f21-468e-9901-455cd3b63c94 req-fa647405-d1b1-4b27-858f-5c956417a700 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] No waiting events found dispatching network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:05:04 user nova-compute[71312]: WARNING nova.compute.manager [req-62d30e54-2f21-468e-9901-455cd3b63c94 req-fa647405-d1b1-4b27-858f-5c956417a700 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received unexpected event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 for instance with vm_state active and task_state rebuild_spawning.
Jul 25 10:05:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-24def2de-b058-462f-8bf9-2b1cdac3241a req-f54c67e2-d5d8-4ca5-a9e7-b68248c2dfdd service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24def2de-b058-462f-8bf9-2b1cdac3241a req-f54c67e2-d5d8-4ca5-a9e7-b68248c2dfdd service nova] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24def2de-b058-462f-8bf9-2b1cdac3241a req-f54c67e2-d5d8-4ca5-a9e7-b68248c2dfdd service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24def2de-b058-462f-8bf9-2b1cdac3241a req-f54c67e2-d5d8-4ca5-a9e7-b68248c2dfdd service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-24def2de-b058-462f-8bf9-2b1cdac3241a req-f54c67e2-d5d8-4ca5-a9e7-b68248c2dfdd service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] No waiting events found dispatching network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:05:04 user nova-compute[71312]: WARNING nova.compute.manager [req-24def2de-b058-462f-8bf9-2b1cdac3241a req-f54c67e2-d5d8-4ca5-a9e7-b68248c2dfdd service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received unexpected event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 for instance with vm_state active and task_state resize_finish.
Jul 25 10:05:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:05:04 user nova-compute[71312]: INFO nova.compute.claims [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Claim successful on node user
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:05:05 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:05:05 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Creating image(s)
Jul 25 10:05:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "/opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "/opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "/opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.policy [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d3a0ce6e0f94fdf90ca72f98c55711a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503c144127642369fc6df38c3da51ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279505.5879898, 9fb85501-6210-4bfd-b496-1891c79fd23c => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:05:05 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] VM Resumed (Lifecycle Event)
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:05:05 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Instance running successfully.
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Failed to set time: agent not configured {{(pid=71312) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53af21de-5ee5-4d6e-a012-ad3ba09de184 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] finish_migration finished successfully. {{(pid=71312) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:05:05 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279505.588997, 9fb85501-6210-4bfd-b496-1891c79fd23c => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:05:05 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] VM Started (Lifecycle Event)
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.157s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:05:05 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 25 10:05:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk 1073741824" returned: 0 in 0.062s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.157s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-4f4c620d-7631-4a73-801b-597ce93ea4e4 req-43e65860-4f39-4955-98c1-4a80ef836709 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4f4c620d-7631-4a73-801b-597ce93ea4e4 req-43e65860-4f39-4955-98c1-4a80ef836709 service nova] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4f4c620d-7631-4a73-801b-597ce93ea4e4 req-43e65860-4f39-4955-98c1-4a80ef836709 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4f4c620d-7631-4a73-801b-597ce93ea4e4 req-43e65860-4f39-4955-98c1-4a80ef836709 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-4f4c620d-7631-4a73-801b-597ce93ea4e4 req-43e65860-4f39-4955-98c1-4a80ef836709 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] No waiting events found dispatching network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:05:06 user nova-compute[71312]: WARNING nova.compute.manager [req-4f4c620d-7631-4a73-801b-597ce93ea4e4 req-43e65860-4f39-4955-98c1-4a80ef836709 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received unexpected event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 for instance with vm_state active and task_state rebuild_spawning.
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279506.1901715, bcc93774-32b0-4592-bf6a-d655bac21d39 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:05:06 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] VM Resumed (Lifecycle Event)
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:05:06 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Instance spawned successfully.
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Cannot resize image /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lazy-loading 'migration_context' on Instance uuid 999efbaf-c2e1-40bc-a952-c65d2ce9a47c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Ensure instance console log exists: /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:06 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279506.1905735, bcc93774-32b0-4592-bf6a-d655bac21d39 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:05:06 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] VM Started (Lifecycle Event)
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:05:06 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71312) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ba257a2-c4e4-42e4-9cff-33efe09a701c tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.086s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Successfully created port: af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:05:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Successfully updated port: af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:05:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "refresh_cache-999efbaf-c2e1-40bc-a952-c65d2ce9a47c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:05:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquired lock "refresh_cache-999efbaf-c2e1-40bc-a952-c65d2ce9a47c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:05:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:05:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-81a26ee6-e3b9-4c86-9ec3-823ed0f06cf4 req-58b62bb5-297f-4e78-8d75-a614b65e249b service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received event network-changed-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-81a26ee6-e3b9-4c86-9ec3-823ed0f06cf4 req-58b62bb5-297f-4e78-8d75-a614b65e249b service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Refreshing instance network info cache due to event network-changed-af6ee907-1823-4491-b764-5f935bcccc39. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:05:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-81a26ee6-e3b9-4c86-9ec3-823ed0f06cf4 req-58b62bb5-297f-4e78-8d75-a614b65e249b service nova] Acquiring lock "refresh_cache-999efbaf-c2e1-40bc-a952-c65d2ce9a47c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:05:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Updating instance_info_cache with network_info: [{"id": "af6ee907-1823-4491-b764-5f935bcccc39", "address": "fa:16:3e:80:bd:76", "network": {"id": "8630c9a5-68e0-4e8f-99c6-3db501a1788f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1102930524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1503c144127642369fc6df38c3da51ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6ee907-18", "ovs_interfaceid": "af6ee907-1823-4491-b764-5f935bcccc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Releasing lock "refresh_cache-999efbaf-c2e1-40bc-a952-c65d2ce9a47c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Instance network_info: |[{"id": "af6ee907-1823-4491-b764-5f935bcccc39", "address": "fa:16:3e:80:bd:76", "network": {"id": "8630c9a5-68e0-4e8f-99c6-3db501a1788f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1102930524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1503c144127642369fc6df38c3da51ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6ee907-18", "ovs_interfaceid": "af6ee907-1823-4491-b764-5f935bcccc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-81a26ee6-e3b9-4c86-9ec3-823ed0f06cf4 req-58b62bb5-297f-4e78-8d75-a614b65e249b service nova] Acquired lock "refresh_cache-999efbaf-c2e1-40bc-a952-c65d2ce9a47c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.network.neutron [req-81a26ee6-e3b9-4c86-9ec3-823ed0f06cf4 req-58b62bb5-297f-4e78-8d75-a614b65e249b service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Refreshing network info cache for port af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Start _get_guest_xml network_info=[{"id": "af6ee907-1823-4491-b764-5f935bcccc39", "address": "fa:16:3e:80:bd:76", "network": {"id": "8630c9a5-68e0-4e8f-99c6-3db501a1788f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1102930524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1503c144127642369fc6df38c3da51ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6ee907-18", "ovs_interfaceid": "af6ee907-1823-4491-b764-5f935bcccc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:05:08 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:05:08 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2000996223',display_name='tempest-TestVolumeSwap-server-2000996223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2000996223',id=16,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW3ojFt+7tTYOQ1Ozw8yQya8eRLTnbKEfPzpSgDo7sJgdRE0ruvpq5SuAVIdLvwZIprdE9Y5FIRR5D0N9Q5xZw9dmxIOiNvZwfCvkOzJy9bTvIMkCyFMF963qkjuatB9w==',key_name='tempest-keypair-711902363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1503c144127642369fc6df38c3da51ca',ramdisk_id='',reservation_id='r-kjy032c8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-990047030',owner_user_name='tempest-TestVolumeSwap-990047030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:05:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d3a0ce6e0f94fdf90ca72f98c55711a',uuid=999efbaf-c2e1-40bc-a952-c65d2ce9a47c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af6ee907-1823-4491-b764-5f935bcccc39", "address": "fa:16:3e:80:bd:76", "network": {"id": "8630c9a5-68e0-4e8f-99c6-3db501a1788f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1102930524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1503c144127642369fc6df38c3da51ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6ee907-18", "ovs_interfaceid": "af6ee907-1823-4491-b764-5f935bcccc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Converting VIF {"id": "af6ee907-1823-4491-b764-5f935bcccc39", "address": "fa:16:3e:80:bd:76", "network": {"id": "8630c9a5-68e0-4e8f-99c6-3db501a1788f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1102930524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1503c144127642369fc6df38c3da51ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6ee907-18", "ovs_interfaceid": "af6ee907-1823-4491-b764-5f935bcccc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=af6ee907-1823-4491-b764-5f935bcccc39,network=Network(8630c9a5-68e0-4e8f-99c6-3db501a1788f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf6ee907-18') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lazy-loading 'pci_devices' on Instance uuid 999efbaf-c2e1-40bc-a952-c65d2ce9a47c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:05:08 user nova-compute[71312]:   <uuid>999efbaf-c2e1-40bc-a952-c65d2ce9a47c</uuid>
Jul 25 10:05:08 user nova-compute[71312]:   <name>instance-00000010</name>
Jul 25 10:05:08 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:05:08 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:05:08 user nova-compute[71312]:   <metadata>
Jul 25 10:05:08 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:05:08 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:05:08 user nova-compute[71312]:       <nova:name>tempest-TestVolumeSwap-server-2000996223</nova:name>
Jul 25 10:05:08 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:05:08</nova:creationTime>
Jul 25 10:05:08 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:05:08 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:05:08 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:05:08 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:05:08 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:05:08 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:05:08 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:05:08 user nova-compute[71312]:       <nova:owner>
Jul 25 10:05:08 user nova-compute[71312]:         <nova:user uuid="6d3a0ce6e0f94fdf90ca72f98c55711a">tempest-TestVolumeSwap-990047030-project-member</nova:user>
Jul 25 10:05:08 user nova-compute[71312]:         <nova:project uuid="1503c144127642369fc6df38c3da51ca">tempest-TestVolumeSwap-990047030</nova:project>
Jul 25 10:05:08 user nova-compute[71312]:       </nova:owner>
Jul 25 10:05:08 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:05:08 user nova-compute[71312]:       <nova:ports>
Jul 25 10:05:08 user nova-compute[71312]:         <nova:port uuid="af6ee907-1823-4491-b764-5f935bcccc39">
Jul 25 10:05:08 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 10:05:08 user nova-compute[71312]:         </nova:port>
Jul 25 10:05:08 user nova-compute[71312]:       </nova:ports>
Jul 25 10:05:08 user nova-compute[71312]:     </nova:instance>
Jul 25 10:05:08 user nova-compute[71312]:   </metadata>
Jul 25 10:05:08 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:05:08 user nova-compute[71312]:     <system>
Jul 25 10:05:08 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:05:08 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:05:08 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:05:08 user nova-compute[71312]:       <entry name="serial">999efbaf-c2e1-40bc-a952-c65d2ce9a47c</entry>
Jul 25 10:05:08 user nova-compute[71312]:       <entry name="uuid">999efbaf-c2e1-40bc-a952-c65d2ce9a47c</entry>
Jul 25 10:05:08 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:05:08 user nova-compute[71312]:     </system>
Jul 25 10:05:08 user nova-compute[71312]:   </sysinfo>
Jul 25 10:05:08 user nova-compute[71312]:   <os>
Jul 25 10:05:08 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:05:08 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:05:08 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:05:08 user nova-compute[71312]:   </os>
Jul 25 10:05:08 user nova-compute[71312]:   <features>
Jul 25 10:05:08 user nova-compute[71312]:     <acpi/>
Jul 25 10:05:08 user nova-compute[71312]:     <apic/>
Jul 25 10:05:08 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:05:08 user nova-compute[71312]:   </features>
Jul 25 10:05:08 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:05:08 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:05:08 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:05:08 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:05:08 user nova-compute[71312]:   </clock>
Jul 25 10:05:08 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:05:08 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:05:08 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:05:08 user nova-compute[71312]:   </cpu>
Jul 25 10:05:08 user nova-compute[71312]:   <devices>
Jul 25 10:05:08 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:05:08 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:05:08 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk"/>
Jul 25 10:05:08 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:05:08 user nova-compute[71312]:     </disk>
Jul 25 10:05:08 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:05:08 user nova-compute[71312]:       <mac address="fa:16:3e:80:bd:76"/>
Jul 25 10:05:08 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:05:08 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:05:08 user nova-compute[71312]:       <target dev="tapaf6ee907-18"/>
Jul 25 10:05:08 user nova-compute[71312]:     </interface>
Jul 25 10:05:08 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:05:08 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/console.log" append="off"/>
Jul 25 10:05:08 user nova-compute[71312]:     </serial>
Jul 25 10:05:08 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:05:08 user nova-compute[71312]:     <video>
Jul 25 10:05:08 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:05:08 user nova-compute[71312]:     </video>
Jul 25 10:05:08 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:05:08 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:05:08 user nova-compute[71312]:     </rng>
Jul 25 10:05:08 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:05:08 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:05:08 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:05:08 user nova-compute[71312]:     </memballoon>
Jul 25 10:05:08 user nova-compute[71312]:   </devices>
Jul 25 10:05:08 user nova-compute[71312]: </domain>
Jul 25 10:05:08 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2000996223',display_name='tempest-TestVolumeSwap-server-2000996223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2000996223',id=16,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW3ojFt+7tTYOQ1Ozw8yQya8eRLTnbKEfPzpSgDo7sJgdRE0ruvpq5SuAVIdLvwZIprdE9Y5FIRR5D0N9Q5xZw9dmxIOiNvZwfCvkOzJy9bTvIMkCyFMF963qkjuatB9w==',key_name='tempest-keypair-711902363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1503c144127642369fc6df38c3da51ca',ramdisk_id='',reservation_id='r-kjy032c8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-990047030',owner_user_name='tempest-TestVolumeSwap-990047030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:05:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d3a0ce6e0f94fdf90ca72f98c55711a',uuid=999efbaf-c2e1-40bc-a952-c65d2ce9a47c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af6ee907-1823-4491-b764-5f935bcccc39", "address": "fa:16:3e:80:bd:76", "network": {"id": "8630c9a5-68e0-4e8f-99c6-3db501a1788f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1102930524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1503c144127642369fc6df38c3da51ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6ee907-18", "ovs_interfaceid": "af6ee907-1823-4491-b764-5f935bcccc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Converting VIF {"id": "af6ee907-1823-4491-b764-5f935bcccc39", "address": "fa:16:3e:80:bd:76", "network": {"id": "8630c9a5-68e0-4e8f-99c6-3db501a1788f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1102930524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1503c144127642369fc6df38c3da51ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6ee907-18", "ovs_interfaceid": "af6ee907-1823-4491-b764-5f935bcccc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=af6ee907-1823-4491-b764-5f935bcccc39,network=Network(8630c9a5-68e0-4e8f-99c6-3db501a1788f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf6ee907-18') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG os_vif [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=af6ee907-1823-4491-b764-5f935bcccc39,network=Network(8630c9a5-68e0-4e8f-99c6-3db501a1788f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf6ee907-18') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf6ee907-18, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf6ee907-18, col_values=(('external_ids', {'iface-id': 'af6ee907-1823-4491-b764-5f935bcccc39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:bd:76', 'vm-uuid': '999efbaf-c2e1-40bc-a952-c65d2ce9a47c'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:08 user nova-compute[71312]: INFO os_vif [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=af6ee907-1823-4491-b764-5f935bcccc39,network=Network(8630c9a5-68e0-4e8f-99c6-3db501a1788f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf6ee907-18')
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:05:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] No VIF found with MAC fa:16:3e:80:bd:76, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:05:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-81a26ee6-e3b9-4c86-9ec3-823ed0f06cf4 req-58b62bb5-297f-4e78-8d75-a614b65e249b service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Updated VIF entry in instance network info cache for port af6ee907-1823-4491-b764-5f935bcccc39. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:05:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-81a26ee6-e3b9-4c86-9ec3-823ed0f06cf4 req-58b62bb5-297f-4e78-8d75-a614b65e249b service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Updating instance_info_cache with network_info: [{"id": "af6ee907-1823-4491-b764-5f935bcccc39", "address": "fa:16:3e:80:bd:76", "network": {"id": "8630c9a5-68e0-4e8f-99c6-3db501a1788f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1102930524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1503c144127642369fc6df38c3da51ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6ee907-18", "ovs_interfaceid": "af6ee907-1823-4491-b764-5f935bcccc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:05:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-81a26ee6-e3b9-4c86-9ec3-823ed0f06cf4 req-58b62bb5-297f-4e78-8d75-a614b65e249b service nova] Releasing lock "refresh_cache-999efbaf-c2e1-40bc-a952-c65d2ce9a47c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:05:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-77fa5b8f-75d5-48af-8262-4c35c020a99b req-4e87c9cc-8e87-46f4-81fe-b061807820e3 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received event network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-77fa5b8f-75d5-48af-8262-4c35c020a99b req-4e87c9cc-8e87-46f4-81fe-b061807820e3 service nova] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-77fa5b8f-75d5-48af-8262-4c35c020a99b req-4e87c9cc-8e87-46f4-81fe-b061807820e3 service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-77fa5b8f-75d5-48af-8262-4c35c020a99b req-4e87c9cc-8e87-46f4-81fe-b061807820e3 service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-77fa5b8f-75d5-48af-8262-4c35c020a99b req-4e87c9cc-8e87-46f4-81fe-b061807820e3 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] No waiting events found dispatching network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:05:10 user nova-compute[71312]: WARNING nova.compute.manager [req-77fa5b8f-75d5-48af-8262-4c35c020a99b req-4e87c9cc-8e87-46f4-81fe-b061807820e3 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received unexpected event network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 for instance with vm_state building and task_state spawning.
Jul 25 10:05:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-7fd14d9b-bb51-49d2-9187-40d8cd650450 req-870fe8f8-332a-4b47-850c-e07809cecb88 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received event network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7fd14d9b-bb51-49d2-9187-40d8cd650450 req-870fe8f8-332a-4b47-850c-e07809cecb88 service nova] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7fd14d9b-bb51-49d2-9187-40d8cd650450 req-870fe8f8-332a-4b47-850c-e07809cecb88 service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7fd14d9b-bb51-49d2-9187-40d8cd650450 req-870fe8f8-332a-4b47-850c-e07809cecb88 service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-7fd14d9b-bb51-49d2-9187-40d8cd650450 req-870fe8f8-332a-4b47-850c-e07809cecb88 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] No waiting events found dispatching network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:05:12 user nova-compute[71312]: WARNING nova.compute.manager [req-7fd14d9b-bb51-49d2-9187-40d8cd650450 req-870fe8f8-332a-4b47-850c-e07809cecb88 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received unexpected event network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 for instance with vm_state building and task_state spawning.
Jul 25 10:05:12 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279512.9939094, 999efbaf-c2e1-40bc-a952-c65d2ce9a47c => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:05:12 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] VM Resumed (Lifecycle Event)
Jul 25 10:05:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:05:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:05:13 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Instance spawned successfully.
Jul 25 10:05:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:05:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:05:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:05:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:13 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:05:13 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279512.9953578, 999efbaf-c2e1-40bc-a952-c65d2ce9a47c => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:05:13 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] VM Started (Lifecycle Event)
Jul 25 10:05:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:05:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:05:13 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:05:13 user nova-compute[71312]: INFO nova.compute.manager [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Took 7.63 seconds to spawn the instance on the hypervisor.
Jul 25 10:05:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:05:13 user nova-compute[71312]: INFO nova.compute.manager [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Took 8.56 seconds to build instance.
Jul 25 10:05:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0a59b820-cc2d-4634-8867-8a3010825221 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.706s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:05:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:16 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:05:16 user nova-compute[71312]: INFO nova.compute.claims [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Claim successful on node user
Jul 25 10:05:16 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:05:16 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.677s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG nova.network.neutron [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:05:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:05:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG nova.policy [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ec3ee9c206b43448eb6479cad0b437c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23211f867d6049f5bb1901e03e8dc396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:05:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Creating image(s)
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "/opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "/opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "/opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.174s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.172s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk 1073741824" returned: 0 in 0.092s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.167s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:18 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Cannot resize image /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:05:18 user nova-compute[71312]: DEBUG nova.objects.instance [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'migration_context' on Instance uuid 9be175c2-20a4-45ce-85a7-ee3c406a4b1f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:05:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:05:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Ensure instance console log exists: /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:05:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Successfully created port: bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:05:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Successfully updated port: bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquired lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-04977846-5472-4265-a1e8-a29f07304ce7 req-19f2869e-d113-477a-a28f-a40334860ed3 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-changed-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-04977846-5472-4265-a1e8-a29f07304ce7 req-19f2869e-d113-477a-a28f-a40334860ed3 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Refreshing instance network info cache due to event network-changed-bd177392-3e41-4cbf-b629-68a33265fae2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04977846-5472-4265-a1e8-a29f07304ce7 req-19f2869e-d113-477a-a28f-a40334860ed3 service nova] Acquiring lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Updating instance_info_cache with network_info: [{"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Releasing lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Instance network_info: |[{"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04977846-5472-4265-a1e8-a29f07304ce7 req-19f2869e-d113-477a-a28f-a40334860ed3 service nova] Acquired lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.network.neutron [req-04977846-5472-4265-a1e8-a29f07304ce7 req-19f2869e-d113-477a-a28f-a40334860ed3 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Refreshing network info cache for port bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Start _get_guest_xml network_info=[{"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:05:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:05:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1905762448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1905762448',id=17,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvKvs8yd/NCFKkUWvMqLOY4/x6Uz25yC2jkPkcm7758dTAqRpS9uCldsrdCsLRvuo94l2rgvDVdbsWq2Cxuin+cxVAQKbFF3fhDUMd0Ge/4O05oIjQjwaOTBjiXtrVtEA==',key_name='tempest-keypair-909376568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23211f867d6049f5bb1901e03e8dc396',ramdisk_id='',reservation_id='r-ker0w51i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1954806993',owner_user_name='tempest-AttachVolumeShelveTestJSON-1954806993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:05:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec3ee9c206b43448eb6479cad0b437c',uuid=9be175c2-20a4-45ce-85a7-ee3c406a4b1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converting VIF {"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:de:ac,bridge_name='br-int',has_traffic_filtering=True,id=bd177392-3e41-4cbf-b629-68a33265fae2,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd177392-3e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'pci_devices' on Instance uuid 9be175c2-20a4-45ce-85a7-ee3c406a4b1f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:05:19 user nova-compute[71312]:   <uuid>9be175c2-20a4-45ce-85a7-ee3c406a4b1f</uuid>
Jul 25 10:05:19 user nova-compute[71312]:   <name>instance-00000011</name>
Jul 25 10:05:19 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:05:19 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:05:19 user nova-compute[71312]:   <metadata>
Jul 25 10:05:19 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:05:19 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:05:19 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1905762448</nova:name>
Jul 25 10:05:19 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:05:19</nova:creationTime>
Jul 25 10:05:19 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:05:19 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:05:19 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:05:19 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:05:19 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:05:19 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:05:19 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:05:19 user nova-compute[71312]:       <nova:owner>
Jul 25 10:05:19 user nova-compute[71312]:         <nova:user uuid="0ec3ee9c206b43448eb6479cad0b437c">tempest-AttachVolumeShelveTestJSON-1954806993-project-member</nova:user>
Jul 25 10:05:19 user nova-compute[71312]:         <nova:project uuid="23211f867d6049f5bb1901e03e8dc396">tempest-AttachVolumeShelveTestJSON-1954806993</nova:project>
Jul 25 10:05:19 user nova-compute[71312]:       </nova:owner>
Jul 25 10:05:19 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:05:19 user nova-compute[71312]:       <nova:ports>
Jul 25 10:05:19 user nova-compute[71312]:         <nova:port uuid="bd177392-3e41-4cbf-b629-68a33265fae2">
Jul 25 10:05:19 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 10:05:19 user nova-compute[71312]:         </nova:port>
Jul 25 10:05:19 user nova-compute[71312]:       </nova:ports>
Jul 25 10:05:19 user nova-compute[71312]:     </nova:instance>
Jul 25 10:05:19 user nova-compute[71312]:   </metadata>
Jul 25 10:05:19 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:05:19 user nova-compute[71312]:     <system>
Jul 25 10:05:19 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:05:19 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:05:19 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:05:19 user nova-compute[71312]:       <entry name="serial">9be175c2-20a4-45ce-85a7-ee3c406a4b1f</entry>
Jul 25 10:05:19 user nova-compute[71312]:       <entry name="uuid">9be175c2-20a4-45ce-85a7-ee3c406a4b1f</entry>
Jul 25 10:05:19 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:05:19 user nova-compute[71312]:     </system>
Jul 25 10:05:19 user nova-compute[71312]:   </sysinfo>
Jul 25 10:05:19 user nova-compute[71312]:   <os>
Jul 25 10:05:19 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:05:19 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:05:19 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:05:19 user nova-compute[71312]:   </os>
Jul 25 10:05:19 user nova-compute[71312]:   <features>
Jul 25 10:05:19 user nova-compute[71312]:     <acpi/>
Jul 25 10:05:19 user nova-compute[71312]:     <apic/>
Jul 25 10:05:19 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:05:19 user nova-compute[71312]:   </features>
Jul 25 10:05:19 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:05:19 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:05:19 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:05:19 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:05:19 user nova-compute[71312]:   </clock>
Jul 25 10:05:19 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:05:19 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:05:19 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:05:19 user nova-compute[71312]:   </cpu>
Jul 25 10:05:19 user nova-compute[71312]:   <devices>
Jul 25 10:05:19 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:05:19 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:05:19 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk"/>
Jul 25 10:05:19 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:05:19 user nova-compute[71312]:     </disk>
Jul 25 10:05:19 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:05:19 user nova-compute[71312]:       <mac address="fa:16:3e:b0:de:ac"/>
Jul 25 10:05:19 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:05:19 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:05:19 user nova-compute[71312]:       <target dev="tapbd177392-3e"/>
Jul 25 10:05:19 user nova-compute[71312]:     </interface>
Jul 25 10:05:19 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:05:19 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/console.log" append="off"/>
Jul 25 10:05:19 user nova-compute[71312]:     </serial>
Jul 25 10:05:19 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:05:19 user nova-compute[71312]:     <video>
Jul 25 10:05:19 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:05:19 user nova-compute[71312]:     </video>
Jul 25 10:05:19 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:05:19 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:05:19 user nova-compute[71312]:     </rng>
Jul 25 10:05:19 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:05:19 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:05:19 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:05:19 user nova-compute[71312]:     </memballoon>
Jul 25 10:05:19 user nova-compute[71312]:   </devices>
Jul 25 10:05:19 user nova-compute[71312]: </domain>
Jul 25 10:05:19 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1905762448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1905762448',id=17,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvKvs8yd/NCFKkUWvMqLOY4/x6Uz25yC2jkPkcm7758dTAqRpS9uCldsrdCsLRvuo94l2rgvDVdbsWq2Cxuin+cxVAQKbFF3fhDUMd0Ge/4O05oIjQjwaOTBjiXtrVtEA==',key_name='tempest-keypair-909376568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23211f867d6049f5bb1901e03e8dc396',ramdisk_id='',reservation_id='r-ker0w51i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1954806993',owner_user_name='tempest-AttachVolumeShelveTestJSON-1954806993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:05:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec3ee9c206b43448eb6479cad0b437c',uuid=9be175c2-20a4-45ce-85a7-ee3c406a4b1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converting VIF {"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:de:ac,bridge_name='br-int',has_traffic_filtering=True,id=bd177392-3e41-4cbf-b629-68a33265fae2,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd177392-3e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG os_vif [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:de:ac,bridge_name='br-int',has_traffic_filtering=True,id=bd177392-3e41-4cbf-b629-68a33265fae2,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd177392-3e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd177392-3e, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd177392-3e, col_values=(('external_ids', {'iface-id': 'bd177392-3e41-4cbf-b629-68a33265fae2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:de:ac', 'vm-uuid': '9be175c2-20a4-45ce-85a7-ee3c406a4b1f'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:19 user nova-compute[71312]: INFO os_vif [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:de:ac,bridge_name='br-int',has_traffic_filtering=True,id=bd177392-3e41-4cbf-b629-68a33265fae2,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd177392-3e')
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:05:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] No VIF found with MAC fa:16:3e:b0:de:ac, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:05:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-04977846-5472-4265-a1e8-a29f07304ce7 req-19f2869e-d113-477a-a28f-a40334860ed3 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Updated VIF entry in instance network info cache for port bd177392-3e41-4cbf-b629-68a33265fae2. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:05:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-04977846-5472-4265-a1e8-a29f07304ce7 req-19f2869e-d113-477a-a28f-a40334860ed3 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Updating instance_info_cache with network_info: [{"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:05:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04977846-5472-4265-a1e8-a29f07304ce7 req-19f2869e-d113-477a-a28f-a40334860ed3 service nova] Releasing lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:05:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-d42f8b55-dbbe-45b0-824d-3980c7e363bc req-9b44352a-efbc-4fd6-aa40-0ff518bd130c service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d42f8b55-dbbe-45b0-824d-3980c7e363bc req-9b44352a-efbc-4fd6-aa40-0ff518bd130c service nova] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d42f8b55-dbbe-45b0-824d-3980c7e363bc req-9b44352a-efbc-4fd6-aa40-0ff518bd130c service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d42f8b55-dbbe-45b0-824d-3980c7e363bc req-9b44352a-efbc-4fd6-aa40-0ff518bd130c service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-d42f8b55-dbbe-45b0-824d-3980c7e363bc req-9b44352a-efbc-4fd6-aa40-0ff518bd130c service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] No waiting events found dispatching network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:05:21 user nova-compute[71312]: WARNING nova.compute.manager [req-d42f8b55-dbbe-45b0-824d-3980c7e363bc req-9b44352a-efbc-4fd6-aa40-0ff518bd130c service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received unexpected event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 for instance with vm_state building and task_state spawning.
Jul 25 10:05:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:22 user nova-compute[71312]: INFO nova.compute.manager [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Rescuing
Jul 25 10:05:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:05:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquired lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:05:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:05:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Updating instance_info_cache with network_info: [{"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:05:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Releasing lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:05:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-92fb3fc2-80aa-45ba-addc-c2ecfb314551 req-ab468a4d-31fb-40af-b41a-6320ce8b2ee1 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-vif-unplugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-92fb3fc2-80aa-45ba-addc-c2ecfb314551 req-ab468a4d-31fb-40af-b41a-6320ce8b2ee1 service nova] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-92fb3fc2-80aa-45ba-addc-c2ecfb314551 req-ab468a4d-31fb-40af-b41a-6320ce8b2ee1 service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-92fb3fc2-80aa-45ba-addc-c2ecfb314551 req-ab468a4d-31fb-40af-b41a-6320ce8b2ee1 service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-92fb3fc2-80aa-45ba-addc-c2ecfb314551 req-ab468a4d-31fb-40af-b41a-6320ce8b2ee1 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] No waiting events found dispatching network-vif-unplugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:05:23 user nova-compute[71312]: WARNING nova.compute.manager [req-92fb3fc2-80aa-45ba-addc-c2ecfb314551 req-ab468a4d-31fb-40af-b41a-6320ce8b2ee1 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received unexpected event network-vif-unplugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a for instance with vm_state active and task_state rescuing.
Jul 25 10:05:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279523.5389297, 9be175c2-20a4-45ce-85a7-ee3c406a4b1f => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:05:23 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] VM Resumed (Lifecycle Event)
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:05:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Instance spawned successfully.
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-3a5906c1-bdbb-4289-8cf7-dac6f2fce936 req-a8547905-73a2-44b4-966a-4c7e1e5f042e service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3a5906c1-bdbb-4289-8cf7-dac6f2fce936 req-a8547905-73a2-44b4-966a-4c7e1e5f042e service nova] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3a5906c1-bdbb-4289-8cf7-dac6f2fce936 req-a8547905-73a2-44b4-966a-4c7e1e5f042e service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3a5906c1-bdbb-4289-8cf7-dac6f2fce936 req-a8547905-73a2-44b4-966a-4c7e1e5f042e service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-3a5906c1-bdbb-4289-8cf7-dac6f2fce936 req-a8547905-73a2-44b4-966a-4c7e1e5f042e service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] No waiting events found dispatching network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:05:23 user nova-compute[71312]: WARNING nova.compute.manager [req-3a5906c1-bdbb-4289-8cf7-dac6f2fce936 req-a8547905-73a2-44b4-966a-4c7e1e5f042e service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received unexpected event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 for instance with vm_state building and task_state spawning.
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Instance destroyed successfully.
Jul 25 10:05:23 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279523.5469253, 9be175c2-20a4-45ce-85a7-ee3c406a4b1f => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:05:23 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] VM Started (Lifecycle Event)
Jul 25 10:05:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Attempting a stable device rescue
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:05:23 user nova-compute[71312]: INFO nova.compute.manager [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Took 6.40 seconds to spawn the instance on the hypervisor.
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71312) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 10:05:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Creating image(s)
Jul 25 10:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "/opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "/opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "/opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8216c52e-c0a7-42b1-9766-7bcffa376b28 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:05:23 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "65fa9c11aab58af54df6e36df9d168d6ce6e4700" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "65fa9c11aab58af54df6e36df9d168d6ce6e4700" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:23 user nova-compute[71312]: INFO nova.compute.manager [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Took 7.51 seconds to build instance.
Jul 25 10:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-847f1535-bc8a-456e-99e9-731d53fd350a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.638s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700.part --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.virt.images [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] 2c98a18d-32a7-4ef9-9fb5-b54faeca289f was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700.part /opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-08505f62-d02a-4274-945e-e05eb2c4d5a7 req-539005b6-029e-4e92-a4c6-03dd1f93bece service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-08505f62-d02a-4274-945e-e05eb2c4d5a7 req-539005b6-029e-4e92-a4c6-03dd1f93bece service nova] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-08505f62-d02a-4274-945e-e05eb2c4d5a7 req-539005b6-029e-4e92-a4c6-03dd1f93bece service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-08505f62-d02a-4274-945e-e05eb2c4d5a7 req-539005b6-029e-4e92-a4c6-03dd1f93bece service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-08505f62-d02a-4274-945e-e05eb2c4d5a7 req-539005b6-029e-4e92-a4c6-03dd1f93bece service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] No waiting events found dispatching network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:05:25 user nova-compute[71312]: WARNING nova.compute.manager [req-08505f62-d02a-4274-945e-e05eb2c4d5a7 req-539005b6-029e-4e92-a4c6-03dd1f93bece service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received unexpected event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a for instance with vm_state active and task_state rescuing.
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700.part /opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700.converted" returned: 0 in 0.278s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "65fa9c11aab58af54df6e36df9d168d6ce6e4700" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.873s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "65fa9c11aab58af54df6e36df9d168d6ce6e4700" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "65fa9c11aab58af54df6e36df9d168d6ce6e4700" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700 --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700,backing_fmt=raw /opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/disk.rescue {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700,backing_fmt=raw /opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/disk.rescue" returned: 0 in 0.074s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "65fa9c11aab58af54df6e36df9d168d6ce6e4700" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'migration_context' on Instance uuid 8216c52e-c0a7-42b1-9766-7bcffa376b28 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Start _get_guest_xml network_info=[{"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "vif_mac": "fa:16:3e:20:f2:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2c98a18d-32a7-4ef9-9fb5-b54faeca289f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '3e62b5ad-a285-4c19-a715-a8ae5324492f', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLcksZOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8216c52e-c0a7-42b1-9766-7bcffa376b28', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe867eea-e811-4400-93ea-32e8399134b6', 'serial': 'fe867eea-e811-4400-93ea-32e8399134b6'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'resources' on Instance uuid 8216c52e-c0a7-42b1-9766-7bcffa376b28 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'numa_topology' on Instance uuid 8216c52e-c0a7-42b1-9766-7bcffa376b28 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:05:25 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:05:25 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:05:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8216c52e-c0a7-42b1-9766-7bcffa376b28 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLcksZOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:05:26 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:05:26 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:05:26 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1438b266-825d-4810-85e1-c5a91d8a6d37]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GLcksZOh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 25 10:05:26 user nova-compute[71312]: node.name = iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:05:26 user nova-compute[71312]: node.tpgt = -1
Jul 25 10:05:26 user nova-compute[71312]: node.startup = automatic
Jul 25 10:05:26 user nova-compute[71312]: node.leading_login = No
Jul 25 10:05:26 user nova-compute[71312]: iface.iscsi_ifacename = default
Jul 25 10:05:26 user nova-compute[71312]: iface.net_ifacename = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.ipaddress = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.prefix_len = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.hwaddress = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.transport_name = tcp
Jul 25 10:05:26 user nova-compute[71312]: iface.initiatorname = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.state = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.vlan_id = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.vlan_priority = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.vlan_state = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.iface_num = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.mtu = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.port = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.bootproto = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.subnet_mask = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.gateway = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.dhcp_alt_client_id_state = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.dhcp_alt_client_id = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.dhcp_dns = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.dhcp_learn_iqn = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.dhcp_req_vendor_id_state = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.dhcp_vendor_id_state = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.dhcp_vendor_id = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.dhcp_slp_da = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.fragmentation = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.gratuitous_arp = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.incoming_forwarding = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.tos_state = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.tos = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.ttl = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.delayed_ack = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.tcp_nagle = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.tcp_wsf_state = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.tcp_wsf = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.tcp_timer_scale = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.tcp_timestamp = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.redirect = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.def_task_mgmt_timeout = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.header_digest = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.data_digest = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.immediate_data = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.initial_r2t = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.data_seq_inorder = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.data_pdu_inorder = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.erl = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.max_receive_data_len = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.first_burst_len = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.max_outstanding_r2t = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.max_burst_len = 0
Jul 25 10:05:26 user nova-compute[71312]: iface.chap_auth = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.bidi_chap = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.strict_login_compliance = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.discovery_auth = <empty>
Jul 25 10:05:26 user nova-compute[71312]: iface.discovery_logout = <empty>
Jul 25 10:05:26 user nova-compute[71312]: node.discovery_address = <empty>
Jul 25 10:05:26 user nova-compute[71312]: node.discovery_port = 0
Jul 25 10:05:26 user nova-compute[71312]: node.discovery_type = static
Jul 25 10:05:26 user nova-compute[71312]: node.session.initial_cmdsn = 0
Jul 25 10:05:26 user nova-compute[71312]: node.session.initial_login_retry_max = 8
Jul 25 10:05:26 user nova-compute[71312]: node.session.xmit_thread_priority = -20
Jul 25 10:05:26 user nova-compute[71312]: node.session.cmds_max = 128
Jul 25 10:05:26 user nova-compute[71312]: node.session.queue_depth = 32
Jul 25 10:05:26 user nova-compute[71312]: node.session.nr_sessions = 1
Jul 25 10:05:26 user nova-compute[71312]: node.session.auth.authmethod = CHAP
Jul 25 10:05:26 user nova-compute[71312]: node.session.auth.username = GLcksZOh
Jul 25 10:05:26 user nova-compute[71312]: node.session.auth.password = ***
Jul 25 10:05:26 user nova-compute[71312]: node.session.auth.username_in = <empty>
Jul 25 10:05:26 user nova-compute[71312]: node.session.auth.password_in = <empty>
Jul 25 10:05:26 user nova-compute[71312]: node.session.auth.chap_algs = MD5
Jul 25 10:05:26 user nova-compute[71312]: node.session.timeo.replacement_timeout = 120
Jul 25 10:05:26 user nova-compute[71312]: node.session.err_timeo.abort_timeout = 15
Jul 25 10:05:26 user nova-compute[71312]: node.session.err_timeo.lu_reset_timeout = 30
Jul 25 10:05:26 user nova-compute[71312]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 25 10:05:26 user nova-compute[71312]: node.session.err_timeo.host_reset_timeout = 60
Jul 25 10:05:26 user nova-compute[71312]: node.session.iscsi.FastAbort = Yes
Jul 25 10:05:26 user nova-compute[71312]: node.session.iscsi.InitialR2T = No
Jul 25 10:05:26 user nova-compute[71312]: node.session.iscsi.ImmediateData = Yes
Jul 25 10:05:26 user nova-compute[71312]: node.session.iscsi.FirstBurstLength = 262144
Jul 25 10:05:26 user nova-compute[71312]: node.session.iscsi.MaxBurstLength = 16776192
Jul 25 10:05:26 user nova-compute[71312]: node.session.iscsi.DefaultTime2Retain = 0
Jul 25 10:05:26 user nova-compute[71312]: node.session.iscsi.DefaultTime2Wait = 2
Jul 25 10:05:26 user nova-compute[71312]: node.session.iscsi.MaxConnections = 1
Jul 25 10:05:26 user nova-compute[71312]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 25 10:05:26 user nova-compute[71312]: node.session.iscsi.ERL = 0
Jul 25 10:05:26 user nova-compute[71312]: node.session.scan = manual
Jul 25 10:05:26 user nova-compute[71312]: node.session.reopen_max = 0
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].address = 172.16.0.220
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].port = 3260
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].startup = manual
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].tcp.window_size = 524288
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].tcp.type_of_service = 0
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].timeo.logout_timeout = 15
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].timeo.login_timeout = 15
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].timeo.auth_timeout = 45
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].timeo.noop_out_interval = 5
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].timeo.noop_out_timeout = 5
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].iscsi.HeaderDigest = None
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].iscsi.DataDigest = None
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].iscsi.IFMarker = No
Jul 25 10:05:26 user nova-compute[71312]: node.conn[0].iscsi.OFMarker = No
Jul 25 10:05:26 user nova-compute[71312]: # END RECORD
Jul 25 10:05:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[347f2b96-1bb8-477b-84b0-9863325fc316]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72d0c56-a3e3-4c21-986f-d55dbcc91cf4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GLcksZOh {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GLcksZOh" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ae04e3-ff29-497d-bcaa-fae5fb317a91]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GLcksZOh'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a4a078-f79c-45a1-a407-c574064380ca]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64ad2ca-122e-47e0-8c61-63320d83feba]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:05:26 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:05:26 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:05:26 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:05:26 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:05:26 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:05:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:05:26 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:05:26 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:05:26 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:05:26 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:05:26 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:05:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.226s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] HCTL ('33', '0', '0', 0) found on session 11 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1522331f-ef93-4134-9c6e-8ae6e512e89d]: (4, ('0 0 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching for a device in session 11 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLcksZOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.259s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] <== connect_volume: return (261ms) {'type': 'block', 'scsi_wwn': '23865313835653631', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865313835653631', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1051551930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1051551930',id=13,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:03:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b14fcd7739f41eabc9e7120f5b58a08',ramdisk_id='',reservation_id='r-nro7mwcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-13369838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:03:51Z,user_data=None,user_id='96d25383d4b6448da2d30479a26bfa0f',uuid=8216c52e-c0a7-42b1-9766-7bcffa376b28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "vif_mac": "fa:16:3e:20:f2:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converting VIF {"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "vif_mac": "fa:16:3e:20:f2:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=3fa3349e-fba2-4bba-a1cb-1ef17e40f35a,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa3349e-fb') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'pci_devices' on Instance uuid 8216c52e-c0a7-42b1-9766-7bcffa376b28 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:05:26 user nova-compute[71312]:   <uuid>8216c52e-c0a7-42b1-9766-7bcffa376b28</uuid>
Jul 25 10:05:26 user nova-compute[71312]:   <name>instance-0000000d</name>
Jul 25 10:05:26 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:05:26 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:05:26 user nova-compute[71312]:   <metadata>
Jul 25 10:05:26 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:05:26 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:05:26 user nova-compute[71312]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1051551930</nova:name>
Jul 25 10:05:26 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:05:25</nova:creationTime>
Jul 25 10:05:26 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:05:26 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:05:26 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:05:26 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:05:26 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:05:26 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:05:26 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:05:26 user nova-compute[71312]:       <nova:owner>
Jul 25 10:05:26 user nova-compute[71312]:         <nova:user uuid="96d25383d4b6448da2d30479a26bfa0f">tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member</nova:user>
Jul 25 10:05:26 user nova-compute[71312]:         <nova:project uuid="0b14fcd7739f41eabc9e7120f5b58a08">tempest-ServerBootFromVolumeStableRescueTest-13369838</nova:project>
Jul 25 10:05:26 user nova-compute[71312]:       </nova:owner>
Jul 25 10:05:26 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:05:26 user nova-compute[71312]:       <nova:ports>
Jul 25 10:05:26 user nova-compute[71312]:         <nova:port uuid="3fa3349e-fba2-4bba-a1cb-1ef17e40f35a">
Jul 25 10:05:26 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 10:05:26 user nova-compute[71312]:         </nova:port>
Jul 25 10:05:26 user nova-compute[71312]:       </nova:ports>
Jul 25 10:05:26 user nova-compute[71312]:     </nova:instance>
Jul 25 10:05:26 user nova-compute[71312]:   </metadata>
Jul 25 10:05:26 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:05:26 user nova-compute[71312]:     <system>
Jul 25 10:05:26 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:05:26 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:05:26 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:05:26 user nova-compute[71312]:       <entry name="serial">8216c52e-c0a7-42b1-9766-7bcffa376b28</entry>
Jul 25 10:05:26 user nova-compute[71312]:       <entry name="uuid">8216c52e-c0a7-42b1-9766-7bcffa376b28</entry>
Jul 25 10:05:26 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:05:26 user nova-compute[71312]:     </system>
Jul 25 10:05:26 user nova-compute[71312]:   </sysinfo>
Jul 25 10:05:26 user nova-compute[71312]:   <os>
Jul 25 10:05:26 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:05:26 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:05:26 user nova-compute[71312]:   </os>
Jul 25 10:05:26 user nova-compute[71312]:   <features>
Jul 25 10:05:26 user nova-compute[71312]:     <acpi/>
Jul 25 10:05:26 user nova-compute[71312]:     <apic/>
Jul 25 10:05:26 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:05:26 user nova-compute[71312]:   </features>
Jul 25 10:05:26 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:05:26 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:05:26 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:05:26 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:05:26 user nova-compute[71312]:   </clock>
Jul 25 10:05:26 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:05:26 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:05:26 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:05:26 user nova-compute[71312]:   </cpu>
Jul 25 10:05:26 user nova-compute[71312]:   <devices>
Jul 25 10:05:26 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:05:26 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:05:26 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Jul 25 10:05:26 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:05:26 user nova-compute[71312]:       <serial>fe867eea-e811-4400-93ea-32e8399134b6</serial>
Jul 25 10:05:26 user nova-compute[71312]:     </disk>
Jul 25 10:05:26 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:05:26 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:05:26 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/disk.rescue"/>
Jul 25 10:05:26 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Jul 25 10:05:26 user nova-compute[71312]:       <boot order="1"/>
Jul 25 10:05:26 user nova-compute[71312]:     </disk>
Jul 25 10:05:26 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:05:26 user nova-compute[71312]:       <mac address="fa:16:3e:20:f2:32"/>
Jul 25 10:05:26 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:05:26 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:05:26 user nova-compute[71312]:       <target dev="tap3fa3349e-fb"/>
Jul 25 10:05:26 user nova-compute[71312]:     </interface>
Jul 25 10:05:26 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:05:26 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/console.log" append="off"/>
Jul 25 10:05:26 user nova-compute[71312]:     </serial>
Jul 25 10:05:26 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:05:26 user nova-compute[71312]:     <video>
Jul 25 10:05:26 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:05:26 user nova-compute[71312]:     </video>
Jul 25 10:05:26 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:05:26 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:05:26 user nova-compute[71312]:     </rng>
Jul 25 10:05:26 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:05:26 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:05:26 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:05:26 user nova-compute[71312]:     </memballoon>
Jul 25 10:05:26 user nova-compute[71312]:   </devices>
Jul 25 10:05:26 user nova-compute[71312]: </domain>
Jul 25 10:05:26 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:05:26 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Instance destroyed successfully.
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:05:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] No VIF found with MAC fa:16:3e:20:f2:32, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updating instance_info_cache with network_info: [{"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-f568375e-e6d9-48aa-9f59-77cc304edc59 req-d0158992-50f7-495e-a8bb-feb40c880e89 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Received event network-changed-21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-f568375e-e6d9-48aa-9f59-77cc304edc59 req-d0158992-50f7-495e-a8bb-feb40c880e89 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Refreshing instance network info cache due to event network-changed-21d54204-0541-4b46-9c4b-13a826123e4a. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f568375e-e6d9-48aa-9f59-77cc304edc59 req-d0158992-50f7-495e-a8bb-feb40c880e89 service nova] Acquiring lock "refresh_cache-8d5e4107-7c28-4c75-aa0a-9e467f0536d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f568375e-e6d9-48aa-9f59-77cc304edc59 req-d0158992-50f7-495e-a8bb-feb40c880e89 service nova] Acquired lock "refresh_cache-8d5e4107-7c28-4c75-aa0a-9e467f0536d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG nova.network.neutron [req-f568375e-e6d9-48aa-9f59-77cc304edc59 req-d0158992-50f7-495e-a8bb-feb40c880e89 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Refreshing network info cache for port 21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-f2dbc4e9-b3be-4978-8df9-ac25a36e93e0 req-1a55db2b-5337-4a04-afdd-c1ab46dcf48f service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f2dbc4e9-b3be-4978-8df9-ac25a36e93e0 req-1a55db2b-5337-4a04-afdd-c1ab46dcf48f service nova] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f2dbc4e9-b3be-4978-8df9-ac25a36e93e0 req-1a55db2b-5337-4a04-afdd-c1ab46dcf48f service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f2dbc4e9-b3be-4978-8df9-ac25a36e93e0 req-1a55db2b-5337-4a04-afdd-c1ab46dcf48f service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-f2dbc4e9-b3be-4978-8df9-ac25a36e93e0 req-1a55db2b-5337-4a04-afdd-c1ab46dcf48f service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] No waiting events found dispatching network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:05:28 user nova-compute[71312]: WARNING nova.compute.manager [req-f2dbc4e9-b3be-4978-8df9-ac25a36e93e0 req-1a55db2b-5337-4a04-afdd-c1ab46dcf48f service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received unexpected event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a for instance with vm_state active and task_state rescuing.
Jul 25 10:05:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG nova.network.neutron [req-f568375e-e6d9-48aa-9f59-77cc304edc59 req-d0158992-50f7-495e-a8bb-feb40c880e89 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Updated VIF entry in instance network info cache for port 21d54204-0541-4b46-9c4b-13a826123e4a. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:05:28 user nova-compute[71312]: DEBUG nova.network.neutron [req-f568375e-e6d9-48aa-9f59-77cc304edc59 req-d0158992-50f7-495e-a8bb-feb40c880e89 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Updating instance_info_cache with network_info: [{"id": "21d54204-0541-4b46-9c4b-13a826123e4a", "address": "fa:16:3e:30:3b:71", "network": {"id": "07adb718-1379-4f03-80cb-84fb5ea2f086", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1044212390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c3e67aaa7e94f2ab8d700776bc203e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d54204-05", "ovs_interfaceid": "21d54204-0541-4b46-9c4b-13a826123e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:05:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f568375e-e6d9-48aa-9f59-77cc304edc59 req-d0158992-50f7-495e-a8bb-feb40c880e89 service nova] Releasing lock "refresh_cache-8d5e4107-7c28-4c75-aa0a-9e467f0536d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:05:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-e14c89cf-b97e-45a7-ac7c-7e10443279a2 req-c8eec6c9-055d-4cbb-988f-455a40a26455 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e14c89cf-b97e-45a7-ac7c-7e10443279a2 req-c8eec6c9-055d-4cbb-988f-455a40a26455 service nova] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e14c89cf-b97e-45a7-ac7c-7e10443279a2 req-c8eec6c9-055d-4cbb-988f-455a40a26455 service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e14c89cf-b97e-45a7-ac7c-7e10443279a2 req-c8eec6c9-055d-4cbb-988f-455a40a26455 service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-e14c89cf-b97e-45a7-ac7c-7e10443279a2 req-c8eec6c9-055d-4cbb-988f-455a40a26455 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] No waiting events found dispatching network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:05:30 user nova-compute[71312]: WARNING nova.compute.manager [req-e14c89cf-b97e-45a7-ac7c-7e10443279a2 req-c8eec6c9-055d-4cbb-988f-455a40a26455 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received unexpected event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a for instance with vm_state active and task_state rescuing.
Jul 25 10:05:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Removed pending event for 8216c52e-c0a7-42b1-9766-7bcffa376b28 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 10:05:31 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279531.0881674, 8216c52e-c0a7-42b1-9766-7bcffa376b28 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:05:31 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] VM Resumed (Lifecycle Event)
Jul 25 10:05:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e3be5951-8a10-4083-b23a-ae32debaa39c tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:05:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:05:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:05:31 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 10:05:31 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279531.0895438, 8216c52e-c0a7-42b1-9766-7bcffa376b28 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:05:31 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] VM Started (Lifecycle Event)
Jul 25 10:05:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:05:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:05:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:05:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:05:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:05:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.133s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:34 user nova-compute[71312]: INFO nova.compute.manager [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Attaching volume 54f8f234-5346-4d32-a62a-e1cb24ce798d to /dev/vdb
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "297fe407-3797-4681-ba83-e0f296780d57" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "297fe407-3797-4681-ba83-e0f296780d57" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG os_brick.utils [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:05:34 user nova-compute[71312]: INFO nova.compute.manager [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Detaching volume 3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ed9b8f-3a9d-4003-82a0-9dde06c0625f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b323475-7fa9-49f6-86a7-940047148df8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:34 user nova-compute[71312]: INFO nova.virt.block_device [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Attempting to driver detach volume 3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 from mountpoint /dev/vdb
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1604e51-f465-47ca-8bc6-0b5b3d8f49d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddfe98c-bb1f-4c86-90ae-c73dbafb353f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Attempting to detach device vdb from instance 297fe407-3797-4681-ba83-e0f296780d57 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:05:34 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:05:34 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:05:34 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:05:34 user nova-compute[71312]:   <serial>3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9</serial>
Jul 25 10:05:34 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:05:34 user nova-compute[71312]: </disk>
Jul 25 10:05:34 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:05:34 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93bf4cd-7d9a-4553-a52d-eb0d13d4ebdc]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG os_brick.utils [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Updating existing volume attachment record: 45f0304a-2a15-4d3d-a297-54e4e3b3b836 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:05:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Successfully detached device vdb from instance 297fe407-3797-4681-ba83-e0f296780d57 from the persistent domain config.
Jul 25 10:05:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 297fe407-3797-4681-ba83-e0f296780d57 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:05:34 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:05:34 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:05:34 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:05:34 user nova-compute[71312]:   <serial>3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9</serial>
Jul 25 10:05:34 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:05:34 user nova-compute[71312]: </disk>
Jul 25 10:05:34 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279535.3693824, 297fe407-3797-4681-ba83-e0f296780d57 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 297fe407-3797-4681-ba83-e0f296780d57 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:05:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Successfully detached device vdb from instance 297fe407-3797-4681-ba83-e0f296780d57 from the live domain config.
Jul 25 10:05:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVcJqHjt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:05:35 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.008s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc951cfb-96f1-4e4e-a339-75d65ccb0ac7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:05:35 user nova-compute[71312]: No targets found.
Jul 25 10:05:35 user nova-compute[71312]: iSNS:
Jul 25 10:05:35 user nova-compute[71312]: No targets found.
Jul 25 10:05:35 user nova-compute[71312]: STATIC:
Jul 25 10:05:35 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac
Jul 25 10:05:35 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:05:35 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:05:35 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:05:35 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:05:35 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:05:35 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9
Jul 25 10:05:35 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:05:35 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:05:35 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:05:35 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:05:35 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:05:35 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670
Jul 25 10:05:35 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:05:35 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:05:35 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120
Jul 25 10:05:35 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:05:35 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:05:35 user nova-compute[71312]: FIRMWARE:
Jul 25 10:05:35 user nova-compute[71312]: No targets found.
Jul 25 10:05:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:05:35 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:05:35 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[58238704-b1af-46eb-ab1f-2bbb9bf4a2ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dced2f-b1db-4204-86ec-eba4889304fe]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:05:35 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:05:35 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:05:35 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:05:35 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:05:35 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:05:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:05:35 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:05:35 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:05:35 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:05:35 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:05:35 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 (non-flash)
Jul 25 10:05:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a87f0160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9'): ({'sdf'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Removing single pathed devices sdf {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d75a6d-50a6-45c8-ae0b-0ebe231ef856]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83100d8-80cf-4b45-bc25-e351d95bf897]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Flushing IO for device /dev/sdf {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3fd22c-2a7c-49f8-83d5-b8455daef497]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ee8158-ce22-47d3-ad21-8ffc58e95f4c]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.053s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad4d60e-9ebe-42a5-98cc-66ffbce26105]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[33408bcd-205b-416e-a82a-fd8886371815]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9, portal: 172.16.0.220,3260]
Jul 25 10:05:35 user nova-compute[71312]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9, portal: 172.16.0.220,3260] successful.
Jul 25 10:05:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fc76f7e-f4dd-4889-a2ec-b4cb35bb4ab9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5831a4-2735-4dc4-8086-4ab2463b5367]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.508s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] <== disconnect_volume: return (516ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:36 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'flavor' on Instance uuid 297fe407-3797-4681-ba83-e0f296780d57 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:05:36 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:05:36 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:05:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=6983MB free_disk=25.28375244140625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:05:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b926a2f-d822-4e0d-b555-25c19273c2c7 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "297fe407-3797-4681-ba83-e0f296780d57" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.242s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Applying migration context for instance 9fb85501-6210-4bfd-b496-1891c79fd23c as it has an incoming, in-progress migration c8f3e6ea-9ac0-45e8-a406-6689fa99cba8. Migration status is finished {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 25 10:05:37 user nova-compute[71312]: INFO nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updating resource usage from migration c8f3e6ea-9ac0-45e8-a406-6689fa99cba8
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 297fe407-3797-4681-ba83-e0f296780d57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 50f8683d-8b60-4095-9507-a969c37f85e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Migration c8f3e6ea-9ac0-45e8-a406-6689fa99cba8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9fb85501-6210-4bfd-b496-1891c79fd23c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 999efbaf-c2e1-40bc-a952-c65d2ce9a47c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9be175c2-20a4-45ce-85a7-ee3c406a4b1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:05:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.842s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:45 user nova-compute[71312]: INFO nova.compute.manager [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Terminating instance
Jul 25 10:05:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:05:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Instance destroyed successfully.
Jul 25 10:05:46 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lazy-loading 'resources' on Instance uuid bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-402470639',display_name='tempest-VolumesAdminNegativeTest-server-402470639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-402470639',id=15,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:03:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95726128af5243deabbbdcd68c5ccdcb',ramdisk_id='',reservation_id='r-hc6uxk0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-692637044',owner_user_name='tempest-VolumesAdminNegativeTest-692637044-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:03:53Z,user_data=None,user_id='2c34765a32ae4f2ba338aec6b2240683',uuid=bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "100f3561-4981-45d9-add5-394b7e0be5bc", "address": "fa:16:3e:99:20:26", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100f3561-49", "ovs_interfaceid": "100f3561-4981-45d9-add5-394b7e0be5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Converting VIF {"id": "100f3561-4981-45d9-add5-394b7e0be5bc", "address": "fa:16:3e:99:20:26", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100f3561-49", "ovs_interfaceid": "100f3561-4981-45d9-add5-394b7e0be5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:20:26,bridge_name='br-int',has_traffic_filtering=True,id=100f3561-4981-45d9-add5-394b7e0be5bc,network=Network(b77e8256-729d-45ef-9624-d10cebfb647a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100f3561-49') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_vif [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:20:26,bridge_name='br-int',has_traffic_filtering=True,id=100f3561-4981-45d9-add5-394b7e0be5bc,network=Network(b77e8256-729d-45ef-9624-d10cebfb647a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100f3561-49') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap100f3561-49, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:46 user nova-compute[71312]: INFO os_vif [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:20:26,bridge_name='br-int',has_traffic_filtering=True,id=100f3561-4981-45d9-add5-394b7e0be5bc,network=Network(b77e8256-729d-45ef-9624-d10cebfb647a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100f3561-49')
Jul 25 10:05:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Deleting instance files /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a_del
Jul 25 10:05:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Deletion of /opt/stack/data/nova/instances/bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a_del complete
Jul 25 10:05:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-6e8d7e88-f3e1-4d64-a00a-c293cc7cf3ca req-4cdaaf42-7896-4283-89f1-9886819b1fd2 service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Received event network-vif-unplugged-100f3561-4981-45d9-add5-394b7e0be5bc {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6e8d7e88-f3e1-4d64-a00a-c293cc7cf3ca req-4cdaaf42-7896-4283-89f1-9886819b1fd2 service nova] Acquiring lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6e8d7e88-f3e1-4d64-a00a-c293cc7cf3ca req-4cdaaf42-7896-4283-89f1-9886819b1fd2 service nova] Lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6e8d7e88-f3e1-4d64-a00a-c293cc7cf3ca req-4cdaaf42-7896-4283-89f1-9886819b1fd2 service nova] Lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-6e8d7e88-f3e1-4d64-a00a-c293cc7cf3ca req-4cdaaf42-7896-4283-89f1-9886819b1fd2 service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] No waiting events found dispatching network-vif-unplugged-100f3561-4981-45d9-add5-394b7e0be5bc {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-6e8d7e88-f3e1-4d64-a00a-c293cc7cf3ca req-4cdaaf42-7896-4283-89f1-9886819b1fd2 service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Received event network-vif-unplugged-100f3561-4981-45d9-add5-394b7e0be5bc for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:05:46 user nova-compute[71312]: INFO nova.compute.manager [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Took 0.71 seconds to destroy the instance on the hypervisor.
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNfcIZYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:05:46 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:05:46 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:05:46 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8610597-52af-4c8e-80bf-6d007742aae5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:05:46 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4008d41f-91e6-4100-928d-bb4330619f9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d] added
Jul 25 10:05:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fef362-1ee5-4ee0-916e-3e5cd4ff1d38]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c2814f-651a-4663-a7b7-6c7923d41869]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNfcIZYa {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNfcIZYa" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9f627a-1f76-4a15-8c70-05eb3cf8da52]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BNfcIZYa'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c1e415-6274-4380-8ecc-56f1a28815b7]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[437a7c57-5fa9-4d1e-928c-507a78d48416]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd670c7-6e80-45ca-8df3-5bdd5fc46a14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d, portal: 172.16.0.220,3260]
Jul 25 10:05:46 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d, portal: 172.16.0.220,3260] successful.
Jul 25 10:05:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc708aa-8e1e-486d-a84c-59143b39d101]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1986c09-87b4-42ed-94a0-6ab50c5596c4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d (non-flash)
Jul 25 10:05:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:05:46 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d (non-flash)
Jul 25 10:05:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3ff7b5-5fac-45ad-8267-b292578d8dc8]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:05:46 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:05:47 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Took 0.63 seconds to deallocate network for instance.
Jul 25 10:05:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-4ce5367c-4a2d-46f6-9073-b743ca278188 req-c22205cf-1cc9-4b86-8792-a5c780a92c6d service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Received event network-vif-deleted-100f3561-4981-45d9-add5-394b7e0be5bc {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:47 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:05:47 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:05:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:47 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Deleted allocations for instance bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a
Jul 25 10:05:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ed15896-440e-4f78-b141-c513ce6fd453 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.008s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:47 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:05:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNfcIZYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:05:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:05:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '26430323232656232', 'path': '/dev/sdf'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:05:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430323232656232', 'path': '/dev/sdf'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:05:47 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:05:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:05:47 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:05:47 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:05:47 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:05:47 user nova-compute[71312]:   <serial>54f8f234-5346-4d32-a62a-e1cb24ce798d</serial>
Jul 25 10:05:47 user nova-compute[71312]: </disk>
Jul 25 10:05:47 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:05:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:05:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:05:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] No VIF found with MAC fa:16:3e:30:3b:71, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:05:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8c4f0a3-1a49-40b4-a0dd-94331f720544 req-d376c9c2-2dc4-448e-9f44-ef8915870d55 service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Received event network-vif-plugged-100f3561-4981-45d9-add5-394b7e0be5bc {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:05:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8c4f0a3-1a49-40b4-a0dd-94331f720544 req-d376c9c2-2dc4-448e-9f44-ef8915870d55 service nova] Acquiring lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:05:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8c4f0a3-1a49-40b4-a0dd-94331f720544 req-d376c9c2-2dc4-448e-9f44-ef8915870d55 service nova] Lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:05:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8c4f0a3-1a49-40b4-a0dd-94331f720544 req-d376c9c2-2dc4-448e-9f44-ef8915870d55 service nova] Lock "bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8c4f0a3-1a49-40b4-a0dd-94331f720544 req-d376c9c2-2dc4-448e-9f44-ef8915870d55 service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] No waiting events found dispatching network-vif-plugged-100f3561-4981-45d9-add5-394b7e0be5bc {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:05:48 user nova-compute[71312]: WARNING nova.compute.manager [req-e8c4f0a3-1a49-40b4-a0dd-94331f720544 req-d376c9c2-2dc4-448e-9f44-ef8915870d55 service nova] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Received unexpected event network-vif-plugged-100f3561-4981-45d9-add5-394b7e0be5bc for instance with vm_state deleted and task_state None.
Jul 25 10:05:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d1004871-6fe9-435c-a1d1-2b8d7b28479d tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.040s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:05:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:05:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:01 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279546.2359078, bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:06:01 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] VM Stopped (Lifecycle Event)
Jul 25 10:06:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6d54bcaa-8eef-4764-aba5-6f5ff049aefd None None] [instance: bf0e46b6-a194-4f89-938a-8fbb1bb7ca9a] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:06:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:05 user nova-compute[71312]: INFO nova.compute.manager [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Detaching volume 54f8f234-5346-4d32-a62a-e1cb24ce798d
Jul 25 10:06:05 user nova-compute[71312]: INFO nova.virt.block_device [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Attempting to driver detach volume 54f8f234-5346-4d32-a62a-e1cb24ce798d from mountpoint /dev/vdb
Jul 25 10:06:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Attempting to detach device vdb from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:06:05 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:06:05 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:06:05 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:06:05 user nova-compute[71312]:   <serial>54f8f234-5346-4d32-a62a-e1cb24ce798d</serial>
Jul 25 10:06:05 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:06:05 user nova-compute[71312]: </disk>
Jul 25 10:06:05 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:06:05 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Successfully detached device vdb from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the persistent domain config.
Jul 25 10:06:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:06:05 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:06:05 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:06:05 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:06:05 user nova-compute[71312]:   <serial>54f8f234-5346-4d32-a62a-e1cb24ce798d</serial>
Jul 25 10:06:05 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:06:05 user nova-compute[71312]: </disk>
Jul 25 10:06:05 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279565.6239493, 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:06:05 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Successfully detached device vdb from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the live domain config.
Jul 25 10:06:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNfcIZYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:06:05 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[282fc331-c6da-4a79-aa69-52ea2cf8c041]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:06:05 user nova-compute[71312]: No targets found.
Jul 25 10:06:05 user nova-compute[71312]: iSNS:
Jul 25 10:06:05 user nova-compute[71312]: No targets found.
Jul 25 10:06:05 user nova-compute[71312]: STATIC:
Jul 25 10:06:05 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac
Jul 25 10:06:05 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:05 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:05 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:06:05 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:05 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:05 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:06:05 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:05 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:05 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670
Jul 25 10:06:05 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:05 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:05 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d
Jul 25 10:06:05 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:05 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:05 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120
Jul 25 10:06:05 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:05 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:05 user nova-compute[71312]: FIRMWARE:
Jul 25 10:06:05 user nova-compute[71312]: No targets found.
Jul 25 10:06:05 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:06:05 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:06:05 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee9b537-7529-4ddb-a135-80b0c838c1ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a91718-d71b-421f-9b23-b850268fd907]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:06:05 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:06:05 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:06:05 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:06:05 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:06:05 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d (non-flash)
Jul 25 10:06:05 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:06:05 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:06:05 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:06:05 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:06:05 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:06:05 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d (non-flash)
Jul 25 10:06:05 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a8620670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d'): ({'sdf'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Removing single pathed devices sdf {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f29ecef-522a-458e-8f33-6ce0c185e5b9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc3d808-2338-4457-91b6-0ad2a256df31]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Flushing IO for device /dev/sdf {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbd75ed-778e-455c-8506-37de4ce602b8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7613aaad-e9fc-4a79-8870-7857b3677627]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5c2ff4-561a-4e5f-a5d8-fde7c1da0cbe]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[972e2fac-04b3-4398-9049-e7f159f1e41c]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d, portal: 172.16.0.220,3260]
Jul 25 10:06:05 user nova-compute[71312]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d, portal: 172.16.0.220,3260] successful.
Jul 25 10:06:05 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f8f234-5346-4d32-a62a-e1cb24ce798d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff453e8-ee76-4f8c-8894-10a1d598d7d5]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] <== disconnect_volume: return (339ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:06:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:06:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:06:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1284edb7-5e1f-45fb-a2e5-b1f5efe21bd1 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.705s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:06:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:06:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 10:06:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:06:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:06:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:06:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:06:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:18 user nova-compute[71312]: INFO nova.compute.manager [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Detaching volume 5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:06:18 user nova-compute[71312]: INFO nova.virt.block_device [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Attempting to driver detach volume 5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 from mountpoint /dev/vdb
Jul 25 10:06:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Attempting to detach device vdb from instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:06:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:06:18 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:06:18 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Jul 25 10:06:18 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:06:18 user nova-compute[71312]:   <serial>5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243</serial>
Jul 25 10:06:18 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 10:06:18 user nova-compute[71312]: </disk>
Jul 25 10:06:18 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:06:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Successfully detached device vdb from instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc from the persistent domain config.
Jul 25 10:06:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:06:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:06:18 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:06:18 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Jul 25 10:06:18 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:06:18 user nova-compute[71312]:   <serial>5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243</serial>
Jul 25 10:06:18 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 10:06:18 user nova-compute[71312]: </disk>
Jul 25 10:06:18 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:06:18 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:06:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-297fe407-3797-4681-ba83-e0f296780d57" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-297fe407-3797-4681-ba83-e0f296780d57" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Port 8727a126-c33f-4868-8651-45e7c1f663d2 binding to destination host user is already ACTIVE {{(pid=71312) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquired lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279579.307927, a35abe6a-0a8b-4eb2-8781-85b99539d1fc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:06:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Successfully detached device vdb from instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc from the live domain config.
Jul 25 10:06:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GVIHKNSo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:06:19 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbf4be3-cf10-438c-b0cc-1ac158bde880]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:06:19 user nova-compute[71312]: No targets found.
Jul 25 10:06:19 user nova-compute[71312]: iSNS:
Jul 25 10:06:19 user nova-compute[71312]: No targets found.
Jul 25 10:06:19 user nova-compute[71312]: STATIC:
Jul 25 10:06:19 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac
Jul 25 10:06:19 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:19 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:19 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:06:19 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:19 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:19 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243
Jul 25 10:06:19 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:19 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:19 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670
Jul 25 10:06:19 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:19 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:19 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120
Jul 25 10:06:19 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:19 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:19 user nova-compute[71312]: FIRMWARE:
Jul 25 10:06:19 user nova-compute[71312]: No targets found.
Jul 25 10:06:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:06:19 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:06:19 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[543d2a5a-e1be-4881-92e0-efba7e3e5339]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4727c753-e9b3-4c5a-a961-c1ac583d5dee]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:06:19 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:06:19 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:06:19 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:06:19 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:06:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:06:19 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 (non-flash)
Jul 25 10:06:19 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:06:19 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:06:19 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:06:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a8620310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd833538-6d31-4934-a8d4-8c195a8d8717]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ce631f-54ad-49f8-ab3a-cd8c9037f651]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7add97-5cd3-4fe0-9525-6d4b82d50a45]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fde3f5c-522f-4198-b99c-b0a71919348e]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a8c7a1-d8e1-4bfd-9cd4-9fcfc1460dc5]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ace4932-6b60-484f-95d1-99cf1c2fd6d9]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260]
Jul 25 10:06:19 user nova-compute[71312]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243, portal: 172.16.0.220,3260] successful.
Jul 25 10:06:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Updating instance_info_cache with network_info: [{"id": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "address": "fa:16:3e:ea:da:e0", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf53ba3e-ce", "ovs_interfaceid": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-297fe407-3797-4681-ba83-e0f296780d57" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6fbe5f-2c4f-4571-92cc-ec92fdd4d243 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1a1ca7-cba7-44f8-ac48-88b9599b4086]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] <== disconnect_volume: return (363ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updating instance_info_cache with network_info: [{"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Releasing lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Creating tmpfile /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/tmpdufnxy6z to verify with other compute node that the instance is on the same shared storage. {{(pid=71312) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 25 10:06:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-4336b737-3536-402b-84a8-4662f0e6793c req-ed8929a8-dbc6-4b9a-8ce8-b403b79be9df service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-vif-unplugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4336b737-3536-402b-84a8-4662f0e6793c req-ed8929a8-dbc6-4b9a-8ce8-b403b79be9df service nova] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4336b737-3536-402b-84a8-4662f0e6793c req-ed8929a8-dbc6-4b9a-8ce8-b403b79be9df service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4336b737-3536-402b-84a8-4662f0e6793c req-ed8929a8-dbc6-4b9a-8ce8-b403b79be9df service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-4336b737-3536-402b-84a8-4662f0e6793c req-ed8929a8-dbc6-4b9a-8ce8-b403b79be9df service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] No waiting events found dispatching network-vif-unplugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:06:20 user nova-compute[71312]: WARNING nova.compute.manager [req-4336b737-3536-402b-84a8-4662f0e6793c req-ed8929a8-dbc6-4b9a-8ce8-b403b79be9df service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received unexpected event network-vif-unplugged-8727a126-c33f-4868-8651-45e7c1f663d2 for instance with vm_state resized and task_state resize_reverting.
Jul 25 10:06:20 user nova-compute[71312]: DEBUG nova.objects.instance [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'flavor' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-40a67742-bd24-47d5-815f-22f2f15ee82d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.860s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Instance destroyed successfully.
Jul 25 10:06:20 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lazy-loading 'resources' on Instance uuid 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704266463',display_name='tempest-ServerActionsTestOtherB-server-704266463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704266463',id=4,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeo1OyzMR1FuY3t9bxVf78EYsomUcs1GBJeQZ+xHk7Q6n7Ea0otdZoq9Stbi9efTSjxNpLsJBFIquobgg119YA0SZsVMkFCxXfGhMNAahmBkXlggOo2Y7cPMghqdLy6UQ==',key_name='tempest-keypair-1722521166',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39ace30139b94322bdc7a657d3546757',ramdisk_id='',reservation_id='r-x9ogqxil',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-766110382',owner_user_name='tempest-ServerActionsTestOtherB-766110382-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5186cf6b19094cb2948a2d4f966f3dcc',uuid=9fb85501-6210-4bfd-b496-1891c79fd23c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converting VIF {"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_vif [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8727a126-c3, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:06:20 user nova-compute[71312]: INFO os_vif [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3')
Jul 25 10:06:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgKmjAwp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:06:20 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9b7a29-b9e8-47b8-aa3c-de30d8a9788b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:06:20 user nova-compute[71312]: No targets found.
Jul 25 10:06:20 user nova-compute[71312]: iSNS:
Jul 25 10:06:20 user nova-compute[71312]: No targets found.
Jul 25 10:06:20 user nova-compute[71312]: STATIC:
Jul 25 10:06:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac
Jul 25 10:06:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:06:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670
Jul 25 10:06:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120
Jul 25 10:06:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:06:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:06:20 user nova-compute[71312]: FIRMWARE:
Jul 25 10:06:20 user nova-compute[71312]: No targets found.
Jul 25 10:06:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:06:20 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:06:20 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fc1d6f-8197-4e9d-82da-4f666856ecc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f667844b-eff1-4cfa-a86e-b5cc7cf3f9ba]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:06:20 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:06:20 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:06:20 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:06:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:06:20 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:06:20 user nova-compute[71312]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:06:20 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:06:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a8511870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac'): ({'sde'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Removing single pathed devices sde {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1636531-d00a-46ea-bb7e-bd1cf5f48edd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[476bb036-d0ca-42d6-b845-4fa7a0df7cef]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Flushing IO for device /dev/sde {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e366954-59af-4e8d-82ff-e139b5370257]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedd329b-f6ca-4841-b0f3-775fb006b3ae]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-93883750-e3dc-43dc-9508-277efc9ff49b tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-93883750-e3dc-43dc-9508-277efc9ff49b tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-93883750-e3dc-43dc-9508-277efc9ff49b tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-93883750-e3dc-43dc-9508-277efc9ff49b tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71312) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3341}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG nova.objects.instance [None req-93883750-e3dc-43dc-9508-277efc9ff49b tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'flavor' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8bff95-a5e0-4fa5-b8a3-b7b862ca5c2e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa92c29-6eba-42e2-be47-d6abdbd3e3d7]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260]
Jul 25 10:06:21 user nova-compute[71312]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260] successful.
Jul 25 10:06:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccfa387-ba93-4f77-bcf4-b503c5f617a6]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] <== disconnect_volume: return (357ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-99af6967-9df5-470b-9e74-75fb4e46e6fe req-2a8cf2a9-5657-44e9-98b2-9095b41c2922 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-vif-unplugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6967-9df5-470b-9e74-75fb4e46e6fe req-2a8cf2a9-5657-44e9-98b2-9095b41c2922 service nova] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6967-9df5-470b-9e74-75fb4e46e6fe req-2a8cf2a9-5657-44e9-98b2-9095b41c2922 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6967-9df5-470b-9e74-75fb4e46e6fe req-2a8cf2a9-5657-44e9-98b2-9095b41c2922 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-99af6967-9df5-470b-9e74-75fb4e46e6fe req-2a8cf2a9-5657-44e9-98b2-9095b41c2922 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] No waiting events found dispatching network-vif-unplugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:06:21 user nova-compute[71312]: WARNING nova.compute.manager [req-99af6967-9df5-470b-9e74-75fb4e46e6fe req-2a8cf2a9-5657-44e9-98b2-9095b41c2922 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received unexpected event network-vif-unplugged-c8954e08-0e8d-41ae-9080-1eb363124b32 for instance with vm_state active and task_state powering-off.
Jul 25 10:06:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Instance destroyed successfully.
Jul 25 10:06:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-93883750-e3dc-43dc-9508-277efc9ff49b tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-93883750-e3dc-43dc-9508-277efc9ff49b tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.908s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lazy-loading 'migration_context' on Instance uuid 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-d407d54d-59aa-434a-aa4d-9f2436d27465 req-2975c3a8-9508-469f-ac6f-bec9ed66dc12 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d407d54d-59aa-434a-aa4d-9f2436d27465 req-2975c3a8-9508-469f-ac6f-bec9ed66dc12 service nova] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d407d54d-59aa-434a-aa4d-9f2436d27465 req-2975c3a8-9508-469f-ac6f-bec9ed66dc12 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d407d54d-59aa-434a-aa4d-9f2436d27465 req-2975c3a8-9508-469f-ac6f-bec9ed66dc12 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-d407d54d-59aa-434a-aa4d-9f2436d27465 req-2975c3a8-9508-469f-ac6f-bec9ed66dc12 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] No waiting events found dispatching network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:06:22 user nova-compute[71312]: WARNING nova.compute.manager [req-d407d54d-59aa-434a-aa4d-9f2436d27465 req-2975c3a8-9508-469f-ac6f-bec9ed66dc12 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received unexpected event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 for instance with vm_state resized and task_state resize_reverting.
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.773s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:22 user nova-compute[71312]: INFO nova.compute.manager [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Swapping old allocation on dict_keys(['c43d9a23-2919-4969-9b66-f1d29eb9e809']) held by migration c8f3e6ea-9ac0-45e8-a406-6689fa99cba8 for instance
Jul 25 10:06:23 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Overwriting current allocation {'allocations': {'c43d9a23-2919-4969-9b66-f1d29eb9e809': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': '39ace30139b94322bdc7a657d3546757', 'user_id': '5186cf6b19094cb2948a2d4f966f3dcc', 'consumer_generation': 1} on consumer 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquired lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-1977a8e6-8841-4d94-806f-1afb2ea1a094 req-01989768-a7b5-4551-87d8-6756e383e090 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1977a8e6-8841-4d94-806f-1afb2ea1a094 req-01989768-a7b5-4551-87d8-6756e383e090 service nova] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1977a8e6-8841-4d94-806f-1afb2ea1a094 req-01989768-a7b5-4551-87d8-6756e383e090 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1977a8e6-8841-4d94-806f-1afb2ea1a094 req-01989768-a7b5-4551-87d8-6756e383e090 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-1977a8e6-8841-4d94-806f-1afb2ea1a094 req-01989768-a7b5-4551-87d8-6756e383e090 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] No waiting events found dispatching network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:06:23 user nova-compute[71312]: WARNING nova.compute.manager [req-1977a8e6-8841-4d94-806f-1afb2ea1a094 req-01989768-a7b5-4551-87d8-6756e383e090 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received unexpected event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 for instance with vm_state stopped and task_state None.
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updating instance_info_cache with network_info: [{"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Releasing lock "refresh_cache-9fb85501-6210-4bfd-b496-1891c79fd23c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG os_brick.utils [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0f5480-f519-43e7-8140-748d9e5badee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc73461-bff0-4f83-b6dd-ee2a4387bbad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[463787d8-dc5a-4e2b-9428-4ee845341115]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bf2219-0b2c-4fb6-965d-ea6c009d4bf3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:06:24 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6ee37d-a487-4cf8-8aa1-de63e6fd664a]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG os_brick.utils [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "297fe407-3797-4681-ba83-e0f296780d57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "297fe407-3797-4681-ba83-e0f296780d57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "297fe407-3797-4681-ba83-e0f296780d57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "297fe407-3797-4681-ba83-e0f296780d57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "297fe407-3797-4681-ba83-e0f296780d57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:25 user nova-compute[71312]: INFO nova.compute.manager [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Terminating instance
Jul 25 10:06:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-50391527-829a-451a-b390-0152f01935ad req-540a2a31-7fa6-4d6d-b630-b842f3f4da76 service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Received event network-vif-unplugged-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-50391527-829a-451a-b390-0152f01935ad req-540a2a31-7fa6-4d6d-b630-b842f3f4da76 service nova] Acquiring lock "297fe407-3797-4681-ba83-e0f296780d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-50391527-829a-451a-b390-0152f01935ad req-540a2a31-7fa6-4d6d-b630-b842f3f4da76 service nova] Lock "297fe407-3797-4681-ba83-e0f296780d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-50391527-829a-451a-b390-0152f01935ad req-540a2a31-7fa6-4d6d-b630-b842f3f4da76 service nova] Lock "297fe407-3797-4681-ba83-e0f296780d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-50391527-829a-451a-b390-0152f01935ad req-540a2a31-7fa6-4d6d-b630-b842f3f4da76 service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] No waiting events found dispatching network-vif-unplugged-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-50391527-829a-451a-b390-0152f01935ad req-540a2a31-7fa6-4d6d-b630-b842f3f4da76 service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Received event network-vif-unplugged-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:06:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:26 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Instance destroyed successfully.
Jul 25 10:06:26 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:06:26 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7144MB free_disk=25.239471435546875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'resources' on Instance uuid 297fe407-3797-4681-ba83-e0f296780d57 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1779173835',display_name='tempest-AttachVolumeNegativeTest-server-1779173835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1779173835',id=6,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCay/WI0FehBNmWmyo9/56LXZ2fXVFsUKftTqyrZn0/BNAzUBzOkXAJ0PX7gx0RbRaJ4cQ4VOqOfc86z63a3zWu10cWC818a9Fb4zxmYn6m0CnCT+MOdKWQ/tglCxVAVwA==',key_name='tempest-keypair-698565757',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a09fcc394c945c2b843abf3df53cda6',ramdisk_id='',reservation_id='r-xi27xemv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1016049404',owner_user_name='tempest-AttachVolumeNegativeTest-1016049404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:00:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe1a69013de4b4dbcb98a35e48d8ee8',uuid=297fe407-3797-4681-ba83-e0f296780d57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "address": "fa:16:3e:ea:da:e0", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf53ba3e-ce", "ovs_interfaceid": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converting VIF {"id": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "address": "fa:16:3e:ea:da:e0", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf53ba3e-ce", "ovs_interfaceid": "bf53ba3e-ce75-4c45-bdcf-0135e786ea67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:da:e0,bridge_name='br-int',has_traffic_filtering=True,id=bf53ba3e-ce75-4c45-bdcf-0135e786ea67,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf53ba3e-ce') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG os_vif [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:da:e0,bridge_name='br-int',has_traffic_filtering=True,id=bf53ba3e-ce75-4c45-bdcf-0135e786ea67,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf53ba3e-ce') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf53ba3e-ce, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:26 user nova-compute[71312]: INFO os_vif [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:da:e0,bridge_name='br-int',has_traffic_filtering=True,id=bf53ba3e-ce75-4c45-bdcf-0135e786ea67,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf53ba3e-ce')
Jul 25 10:06:26 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Deleting instance files /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57_del
Jul 25 10:06:26 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Deletion of /opt/stack/data/nova/instances/297fe407-3797-4681-ba83-e0f296780d57_del complete
Jul 25 10:06:26 user nova-compute[71312]: INFO nova.compute.manager [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Took 1.38 seconds to destroy the instance on the hypervisor.
Jul 25 10:06:26 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 297fe407-3797-4681-ba83-e0f296780d57] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 297fe407-3797-4681-ba83-e0f296780d57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 50f8683d-8b60-4095-9507-a969c37f85e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9fb85501-6210-4bfd-b496-1891c79fd23c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 999efbaf-c2e1-40bc-a952-c65d2ce9a47c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9be175c2-20a4-45ce-85a7-ee3c406a4b1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing inventories for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Updating ProviderTree inventory for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Updating inventory in ProviderTree for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing aggregate associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 10:06:26 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing trait associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, traits: COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 10:06:27 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:06:27 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:06:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:06:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.897s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:06:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-cbe39132-bfa0-4624-bc82-b48a9904dc03 req-8352ba0d-5ed9-488b-bea7-b4191283f114 service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Received event network-vif-plugged-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cbe39132-bfa0-4624-bc82-b48a9904dc03 req-8352ba0d-5ed9-488b-bea7-b4191283f114 service nova] Acquiring lock "297fe407-3797-4681-ba83-e0f296780d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cbe39132-bfa0-4624-bc82-b48a9904dc03 req-8352ba0d-5ed9-488b-bea7-b4191283f114 service nova] Lock "297fe407-3797-4681-ba83-e0f296780d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cbe39132-bfa0-4624-bc82-b48a9904dc03 req-8352ba0d-5ed9-488b-bea7-b4191283f114 service nova] Lock "297fe407-3797-4681-ba83-e0f296780d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-cbe39132-bfa0-4624-bc82-b48a9904dc03 req-8352ba0d-5ed9-488b-bea7-b4191283f114 service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] No waiting events found dispatching network-vif-plugged-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:06:27 user nova-compute[71312]: WARNING nova.compute.manager [req-cbe39132-bfa0-4624-bc82-b48a9904dc03 req-8352ba0d-5ed9-488b-bea7-b4191283f114 service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Received unexpected event network-vif-plugged-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 for instance with vm_state active and task_state deleting.
Jul 25 10:06:27 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:06:27 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Took 1.36 seconds to deallocate network for instance.
Jul 25 10:06:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:28 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:06:28 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:06:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:28 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Deleted allocations for instance 297fe407-3797-4681-ba83-e0f296780d57
Jul 25 10:06:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3eb3c55-0f37-4e85-aa06-db905ad0181b tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "297fe407-3797-4681-ba83-e0f296780d57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.425s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-e13602a3-a644-461a-a3cc-47f4e7ce723a req-5e63c7f8-e1ef-4db3-9660-82b86b118ecd service nova] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Received event network-vif-deleted-bf53ba3e-ce75-4c45-bdcf-0135e786ea67 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:30 user nova-compute[71312]: INFO nova.compute.manager [None req-57429e33-3456-42e4-baae-0b2ff6e7c07e tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Unrescuing
Jul 25 10:06:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-57429e33-3456-42e4-baae-0b2ff6e7c07e tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:06:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-57429e33-3456-42e4-baae-0b2ff6e7c07e tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquired lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:06:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-57429e33-3456-42e4-baae-0b2ff6e7c07e tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:06:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-57429e33-3456-42e4-baae-0b2ff6e7c07e tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Updating instance_info_cache with network_info: [{"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:06:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-57429e33-3456-42e4-baae-0b2ff6e7c07e tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Releasing lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:06:30 user nova-compute[71312]: DEBUG nova.objects.instance [None req-57429e33-3456-42e4-baae-0b2ff6e7c07e tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lazy-loading 'flavor' on Instance uuid cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-7ed65416-7360-4ac4-bc6c-81316ffe63f1 req-9e725ed1-cc47-4bc7-969b-39ef571de84f service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-changed-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-7ed65416-7360-4ac4-bc6c-81316ffe63f1 req-9e725ed1-cc47-4bc7-969b-39ef571de84f service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Refreshing instance network info cache due to event network-changed-63f89ec1-70e3-4e23-ad25-c0f935da374d. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7ed65416-7360-4ac4-bc6c-81316ffe63f1 req-9e725ed1-cc47-4bc7-969b-39ef571de84f service nova] Acquiring lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7ed65416-7360-4ac4-bc6c-81316ffe63f1 req-9e725ed1-cc47-4bc7-969b-39ef571de84f service nova] Acquired lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.network.neutron [req-7ed65416-7360-4ac4-bc6c-81316ffe63f1 req-9e725ed1-cc47-4bc7-969b-39ef571de84f service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Refreshing network info cache for port 63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-db4deeda-9281-4ea9-b4b2-a942b0629c67 req-cf90b87c-6583-47d5-ae33-e7dafb0aae0b service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-vif-unplugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db4deeda-9281-4ea9-b4b2-a942b0629c67 req-cf90b87c-6583-47d5-ae33-e7dafb0aae0b service nova] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db4deeda-9281-4ea9-b4b2-a942b0629c67 req-cf90b87c-6583-47d5-ae33-e7dafb0aae0b service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db4deeda-9281-4ea9-b4b2-a942b0629c67 req-cf90b87c-6583-47d5-ae33-e7dafb0aae0b service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-db4deeda-9281-4ea9-b4b2-a942b0629c67 req-cf90b87c-6583-47d5-ae33-e7dafb0aae0b service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] No waiting events found dispatching network-vif-unplugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:06:31 user nova-compute[71312]: WARNING nova.compute.manager [req-db4deeda-9281-4ea9-b4b2-a942b0629c67 req-cf90b87c-6583-47d5-ae33-e7dafb0aae0b service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received unexpected event network-vif-unplugged-63f89ec1-70e3-4e23-ad25-c0f935da374d for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-db4deeda-9281-4ea9-b4b2-a942b0629c67 req-cf90b87c-6583-47d5-ae33-e7dafb0aae0b service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db4deeda-9281-4ea9-b4b2-a942b0629c67 req-cf90b87c-6583-47d5-ae33-e7dafb0aae0b service nova] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db4deeda-9281-4ea9-b4b2-a942b0629c67 req-cf90b87c-6583-47d5-ae33-e7dafb0aae0b service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db4deeda-9281-4ea9-b4b2-a942b0629c67 req-cf90b87c-6583-47d5-ae33-e7dafb0aae0b service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-db4deeda-9281-4ea9-b4b2-a942b0629c67 req-cf90b87c-6583-47d5-ae33-e7dafb0aae0b service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] No waiting events found dispatching network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:06:31 user nova-compute[71312]: WARNING nova.compute.manager [req-db4deeda-9281-4ea9-b4b2-a942b0629c67 req-cf90b87c-6583-47d5-ae33-e7dafb0aae0b service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received unexpected event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:06:31 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Instance destroyed successfully.
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Starting finish_revert_migration {{(pid=71312) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Start _get_guest_xml network_info=[{"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '6cbac95e-a3f6-4282-b828-3f4e22cfefc6', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgKmjAwp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9fb85501-6210-4bfd-b496-1891c79fd23c', 'attached_at': '2023-07-25T10:06:32.000000', 'detached_at': '', 'volume_id': 'e3bd4850-4e1c-4068-b953-75f6c4c360ac', 'serial': 'e3bd4850-4e1c-4068-b953-75f6c4c360ac'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:06:31 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:06:31 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgKmjAwp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:06:31 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:06:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:06:31 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:06:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:06:31 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac54a3f-6b70-4060-8965-6dd5832c1506]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:06:31 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c324d63c-fdad-414b-bf27-d7afa681831e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac] added
Jul 25 10:06:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c530bc6-3858-4414-ba4e-57b6eb22a19c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c042093f-5d39-4457-9a62-150c20e41a29]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgKmjAwp {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgKmjAwp" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5693912e-0a6f-4ca0-a304-ad22c6f07308]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IgKmjAwp'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[32647b4d-b287-4549-9d5e-2670f0de5f8d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b5cdab-c755-422d-8886-896f9a45a041]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:06:32 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:06:32 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:06:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:06:32 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:06:32 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:06:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d13612-d625-4760-b966-dc84a2e3030e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260]
Jul 25 10:06:32 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260] successful.
Jul 25 10:06:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb31a715-6451-4807-ae5f-aa1f03870550]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[272239a0-a469-43d2-a1d6-86e1396ac169]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:06:32 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:06:32 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:06:32 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:06:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:06:32 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:06:32 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:06:32 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:06:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[69170cbd-7f86-4d72-9882-07780df78898]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgKmjAwp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG nova.network.neutron [req-7ed65416-7360-4ac4-bc6c-81316ffe63f1 req-9e725ed1-cc47-4bc7-969b-39ef571de84f service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Updated VIF entry in instance network info cache for port 63f89ec1-70e3-4e23-ad25-c0f935da374d. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG nova.network.neutron [req-7ed65416-7360-4ac4-bc6c-81316ffe63f1 req-9e725ed1-cc47-4bc7-969b-39ef571de84f service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Updating instance_info_cache with network_info: [{"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:06:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7ed65416-7360-4ac4-bc6c-81316ffe63f1 req-9e725ed1-cc47-4bc7-969b-39ef571de84f service nova] Releasing lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23236323063383638', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236323063383638', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704266463',display_name='tempest-ServerActionsTestOtherB-server-704266463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704266463',id=4,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeo1OyzMR1FuY3t9bxVf78EYsomUcs1GBJeQZ+xHk7Q6n7Ea0otdZoq9Stbi9efTSjxNpLsJBFIquobgg119YA0SZsVMkFCxXfGhMNAahmBkXlggOo2Y7cPMghqdLy6UQ==',key_name='tempest-keypair-1722521166',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='39ace30139b94322bdc7a657d3546757',ramdisk_id='',reservation_id='r-x9ogqxil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-766110382',owner_user_name='tempest-ServerActionsTestOtherB-766110382-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5186cf6b19094cb2948a2d4f966f3dcc',uuid=9fb85501-6210-4bfd-b496-1891c79fd23c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converting VIF {"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:06:33 user nova-compute[71312]:   <uuid>9fb85501-6210-4bfd-b496-1891c79fd23c</uuid>
Jul 25 10:06:33 user nova-compute[71312]:   <name>instance-00000004</name>
Jul 25 10:06:33 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:06:33 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:06:33 user nova-compute[71312]:   <metadata>
Jul 25 10:06:33 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:06:33 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:06:33 user nova-compute[71312]:       <nova:name>tempest-ServerActionsTestOtherB-server-704266463</nova:name>
Jul 25 10:06:33 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:06:31</nova:creationTime>
Jul 25 10:06:33 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:06:33 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:06:33 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:06:33 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:06:33 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:06:33 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:06:33 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:06:33 user nova-compute[71312]:       <nova:owner>
Jul 25 10:06:33 user nova-compute[71312]:         <nova:user uuid="5186cf6b19094cb2948a2d4f966f3dcc">tempest-ServerActionsTestOtherB-766110382-project-member</nova:user>
Jul 25 10:06:33 user nova-compute[71312]:         <nova:project uuid="39ace30139b94322bdc7a657d3546757">tempest-ServerActionsTestOtherB-766110382</nova:project>
Jul 25 10:06:33 user nova-compute[71312]:       </nova:owner>
Jul 25 10:06:33 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:06:33 user nova-compute[71312]:       <nova:ports>
Jul 25 10:06:33 user nova-compute[71312]:         <nova:port uuid="8727a126-c33f-4868-8651-45e7c1f663d2">
Jul 25 10:06:33 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:06:33 user nova-compute[71312]:         </nova:port>
Jul 25 10:06:33 user nova-compute[71312]:       </nova:ports>
Jul 25 10:06:33 user nova-compute[71312]:     </nova:instance>
Jul 25 10:06:33 user nova-compute[71312]:   </metadata>
Jul 25 10:06:33 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:06:33 user nova-compute[71312]:     <system>
Jul 25 10:06:33 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:06:33 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:06:33 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:06:33 user nova-compute[71312]:       <entry name="serial">9fb85501-6210-4bfd-b496-1891c79fd23c</entry>
Jul 25 10:06:33 user nova-compute[71312]:       <entry name="uuid">9fb85501-6210-4bfd-b496-1891c79fd23c</entry>
Jul 25 10:06:33 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:06:33 user nova-compute[71312]:     </system>
Jul 25 10:06:33 user nova-compute[71312]:   </sysinfo>
Jul 25 10:06:33 user nova-compute[71312]:   <os>
Jul 25 10:06:33 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:06:33 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:06:33 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:06:33 user nova-compute[71312]:   </os>
Jul 25 10:06:33 user nova-compute[71312]:   <features>
Jul 25 10:06:33 user nova-compute[71312]:     <acpi/>
Jul 25 10:06:33 user nova-compute[71312]:     <apic/>
Jul 25 10:06:33 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:06:33 user nova-compute[71312]:   </features>
Jul 25 10:06:33 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:06:33 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:06:33 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:06:33 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:06:33 user nova-compute[71312]:   </clock>
Jul 25 10:06:33 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:06:33 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:06:33 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:06:33 user nova-compute[71312]:   </cpu>
Jul 25 10:06:33 user nova-compute[71312]:   <devices>
Jul 25 10:06:33 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:06:33 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:06:33 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk"/>
Jul 25 10:06:33 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:06:33 user nova-compute[71312]:     </disk>
Jul 25 10:06:33 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:06:33 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:06:33 user nova-compute[71312]:       <source dev="/dev/sdd"/>
Jul 25 10:06:33 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Jul 25 10:06:33 user nova-compute[71312]:       <serial>e3bd4850-4e1c-4068-b953-75f6c4c360ac</serial>
Jul 25 10:06:33 user nova-compute[71312]:     </disk>
Jul 25 10:06:33 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:06:33 user nova-compute[71312]:       <mac address="fa:16:3e:60:72:df"/>
Jul 25 10:06:33 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:06:33 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:06:33 user nova-compute[71312]:       <target dev="tap8727a126-c3"/>
Jul 25 10:06:33 user nova-compute[71312]:     </interface>
Jul 25 10:06:33 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:06:33 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/console.log" append="off"/>
Jul 25 10:06:33 user nova-compute[71312]:     </serial>
Jul 25 10:06:33 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:06:33 user nova-compute[71312]:     <video>
Jul 25 10:06:33 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:06:33 user nova-compute[71312]:     </video>
Jul 25 10:06:33 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:06:33 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:06:33 user nova-compute[71312]:     </rng>
Jul 25 10:06:33 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:06:33 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:06:33 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:06:33 user nova-compute[71312]:     </memballoon>
Jul 25 10:06:33 user nova-compute[71312]:   </devices>
Jul 25 10:06:33 user nova-compute[71312]: </domain>
Jul 25 10:06:33 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704266463',display_name='tempest-ServerActionsTestOtherB-server-704266463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704266463',id=4,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeo1OyzMR1FuY3t9bxVf78EYsomUcs1GBJeQZ+xHk7Q6n7Ea0otdZoq9Stbi9efTSjxNpLsJBFIquobgg119YA0SZsVMkFCxXfGhMNAahmBkXlggOo2Y7cPMghqdLy6UQ==',key_name='tempest-keypair-1722521166',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='39ace30139b94322bdc7a657d3546757',ramdisk_id='',reservation_id='r-x9ogqxil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-766110382',owner_user_name='tempest-ServerActionsTestOtherB-766110382-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5186cf6b19094cb2948a2d4f966f3dcc',uuid=9fb85501-6210-4bfd-b496-1891c79fd23c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converting VIF {"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG os_vif [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8727a126-c3, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8727a126-c3, col_values=(('external_ids', {'iface-id': '8727a126-c33f-4868-8651-45e7c1f663d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:72:df', 'vm-uuid': '9fb85501-6210-4bfd-b496-1891c79fd23c'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:33 user nova-compute[71312]: INFO os_vif [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3')
Jul 25 10:06:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-6d5a61b2-0379-4980-83a7-0ff86f7ca7bf req-4a52697d-99b5-489d-b6b7-fc9b7facead2 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-changed-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-6d5a61b2-0379-4980-83a7-0ff86f7ca7bf req-4a52697d-99b5-489d-b6b7-fc9b7facead2 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Refreshing instance network info cache due to event network-changed-63f89ec1-70e3-4e23-ad25-c0f935da374d. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6d5a61b2-0379-4980-83a7-0ff86f7ca7bf req-4a52697d-99b5-489d-b6b7-fc9b7facead2 service nova] Acquiring lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6d5a61b2-0379-4980-83a7-0ff86f7ca7bf req-4a52697d-99b5-489d-b6b7-fc9b7facead2 service nova] Acquired lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG nova.network.neutron [req-6d5a61b2-0379-4980-83a7-0ff86f7ca7bf req-4a52697d-99b5-489d-b6b7-fc9b7facead2 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Refreshing network info cache for port 63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-851a30a8-85d3-4032-a801-c9ff7dc3d4ba req-db00f8d2-354b-481a-8359-ffc34a84e494 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-851a30a8-85d3-4032-a801-c9ff7dc3d4ba req-db00f8d2-354b-481a-8359-ffc34a84e494 service nova] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-851a30a8-85d3-4032-a801-c9ff7dc3d4ba req-db00f8d2-354b-481a-8359-ffc34a84e494 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-851a30a8-85d3-4032-a801-c9ff7dc3d4ba req-db00f8d2-354b-481a-8359-ffc34a84e494 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-851a30a8-85d3-4032-a801-c9ff7dc3d4ba req-db00f8d2-354b-481a-8359-ffc34a84e494 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] No waiting events found dispatching network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:06:33 user nova-compute[71312]: WARNING nova.compute.manager [req-851a30a8-85d3-4032-a801-c9ff7dc3d4ba req-db00f8d2-354b-481a-8359-ffc34a84e494 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received unexpected event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:34 user nova-compute[71312]: DEBUG nova.network.neutron [req-6d5a61b2-0379-4980-83a7-0ff86f7ca7bf req-4a52697d-99b5-489d-b6b7-fc9b7facead2 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Updated VIF entry in instance network info cache for port 63f89ec1-70e3-4e23-ad25-c0f935da374d. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:06:34 user nova-compute[71312]: DEBUG nova.network.neutron [req-6d5a61b2-0379-4980-83a7-0ff86f7ca7bf req-4a52697d-99b5-489d-b6b7-fc9b7facead2 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Updating instance_info_cache with network_info: [{"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:06:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6d5a61b2-0379-4980-83a7-0ff86f7ca7bf req-4a52697d-99b5-489d-b6b7-fc9b7facead2 service nova] Releasing lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279580.699872, 9fb85501-6210-4bfd-b496-1891c79fd23c => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:06:35 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] VM Stopped (Lifecycle Event)
Jul 25 10:06:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f97b947c-3078-4993-92c8-248d70c37404 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] No waiting events found dispatching network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:06:35 user nova-compute[71312]: WARNING nova.compute.manager [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received unexpected event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:06:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] No waiting events found dispatching network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:06:35 user nova-compute[71312]: WARNING nova.compute.manager [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received unexpected event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 for instance with vm_state resized and task_state resize_reverting.
Jul 25 10:06:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] No waiting events found dispatching network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:06:35 user nova-compute[71312]: WARNING nova.compute.manager [req-212b855f-76bc-450f-a48f-0fb428a1e9ca req-d573a602-91ef-451c-866a-ab3f11f43f66 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received unexpected event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 for instance with vm_state resized and task_state resize_reverting.
Jul 25 10:06:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Removed pending event for cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 10:06:36 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279596.5528214, cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:06:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] VM Resumed (Lifecycle Event)
Jul 25 10:06:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-57429e33-3456-42e4-baae-0b2ff6e7c07e tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:06:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:06:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:06:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 25 10:06:36 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279596.5566053, cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:06:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] VM Started (Lifecycle Event)
Jul 25 10:06:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:06:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:06:36 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279581.8098097, a35abe6a-0a8b-4eb2-8781-85b99539d1fc => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:06:36 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] VM Stopped (Lifecycle Event)
Jul 25 10:06:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-39f42017-cdc3-40f0-90ed-b9a359fe9bf3 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:06:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-39f42017-cdc3-40f0-90ed-b9a359fe9bf3 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:06:37 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279597.1622605, 9fb85501-6210-4bfd-b496-1891c79fd23c => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:06:37 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] VM Resumed (Lifecycle Event)
Jul 25 10:06:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:06:37 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Instance running successfully.
Jul 25 10:06:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] finish_revert_migration finished successfully. {{(pid=71312) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 25 10:06:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:06:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:06:37 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 25 10:06:37 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279597.1653626, 9fb85501-6210-4bfd-b496-1891c79fd23c => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:06:37 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] VM Started (Lifecycle Event)
Jul 25 10:06:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:06:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:06:37 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 25 10:06:37 user nova-compute[71312]: INFO nova.compute.manager [None req-b8e4f18b-ab50-4f2d-82f8-4ee8876f06c7 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updating instance to original state: 'active'
Jul 25 10:06:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:41 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279585.7715957, 297fe407-3797-4681-ba83-e0f296780d57 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:06:41 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 297fe407-3797-4681-ba83-e0f296780d57] VM Stopped (Lifecycle Event)
Jul 25 10:06:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-268a86fe-81f9-4ad1-83f7-3a5f6f13b3b8 None None] [instance: 297fe407-3797-4681-ba83-e0f296780d57] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:06:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "50f8683d-8b60-4095-9507-a969c37f85e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "50f8683d-8b60-4095-9507-a969c37f85e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:41 user nova-compute[71312]: INFO nova.compute.manager [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Terminating instance
Jul 25 10:06:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:06:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-13db434f-25b7-48dc-a0f4-1766b96b4801 req-401d5a3c-2cc0-4e25-93f2-e5f7e89c409b service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Received event network-vif-unplugged-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-13db434f-25b7-48dc-a0f4-1766b96b4801 req-401d5a3c-2cc0-4e25-93f2-e5f7e89c409b service nova] Acquiring lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-13db434f-25b7-48dc-a0f4-1766b96b4801 req-401d5a3c-2cc0-4e25-93f2-e5f7e89c409b service nova] Lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-13db434f-25b7-48dc-a0f4-1766b96b4801 req-401d5a3c-2cc0-4e25-93f2-e5f7e89c409b service nova] Lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-13db434f-25b7-48dc-a0f4-1766b96b4801 req-401d5a3c-2cc0-4e25-93f2-e5f7e89c409b service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] No waiting events found dispatching network-vif-unplugged-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-13db434f-25b7-48dc-a0f4-1766b96b4801 req-401d5a3c-2cc0-4e25-93f2-e5f7e89c409b service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Received event network-vif-unplugged-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:42 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Instance destroyed successfully.
Jul 25 10:06:42 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lazy-loading 'resources' on Instance uuid 50f8683d-8b60-4095-9507-a969c37f85e2 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-986570150',display_name='tempest-VolumesAdminNegativeTest-server-986570150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-986570150',id=8,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+siUtbUz/gIwAYoEssSRmdxmJ/sTqkWRHqIiQ4uLGIeEbodFp4HCnBENPOGH+Gqkhyq1MRG/BStmdBjspJLBxXUckt7DnkkNFUpjJc6XoQ7xU0c0CrylA6PTT1hyzsNA==',key_name='tempest-keypair-62837061',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:01:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95726128af5243deabbbdcd68c5ccdcb',ramdisk_id='',reservation_id='r-qi90eq27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-692637044',owner_user_name='tempest-VolumesAdminNegativeTest-692637044-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c34765a32ae4f2ba338aec6b2240683',uuid=50f8683d-8b60-4095-9507-a969c37f85e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "address": "fa:16:3e:5d:33:72", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643c7ae-df", "ovs_interfaceid": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Converting VIF {"id": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "address": "fa:16:3e:5d:33:72", "network": {"id": "b77e8256-729d-45ef-9624-d10cebfb647a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511110078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95726128af5243deabbbdcd68c5ccdcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0643c7ae-df", "ovs_interfaceid": "0643c7ae-df24-43ff-8a02-2d4bd1f1cb39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:33:72,bridge_name='br-int',has_traffic_filtering=True,id=0643c7ae-df24-43ff-8a02-2d4bd1f1cb39,network=Network(b77e8256-729d-45ef-9624-d10cebfb647a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0643c7ae-df') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG os_vif [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:33:72,bridge_name='br-int',has_traffic_filtering=True,id=0643c7ae-df24-43ff-8a02-2d4bd1f1cb39,network=Network(b77e8256-729d-45ef-9624-d10cebfb647a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0643c7ae-df') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0643c7ae-df, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:42 user nova-compute[71312]: INFO os_vif [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:33:72,bridge_name='br-int',has_traffic_filtering=True,id=0643c7ae-df24-43ff-8a02-2d4bd1f1cb39,network=Network(b77e8256-729d-45ef-9624-d10cebfb647a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0643c7ae-df')
Jul 25 10:06:42 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Deleting instance files /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2_del
Jul 25 10:06:42 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Deletion of /opt/stack/data/nova/instances/50f8683d-8b60-4095-9507-a969c37f85e2_del complete
Jul 25 10:06:42 user nova-compute[71312]: INFO nova.compute.manager [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Took 1.08 seconds to destroy the instance on the hypervisor.
Jul 25 10:06:42 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:06:42 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:06:43 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:06:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8c672c3-16bc-4b5b-be2e-0e758c1ba2cf req-6edc926d-ca42-4759-8bdf-979e46a35553 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Received event network-vif-deleted-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:43 user nova-compute[71312]: INFO nova.compute.manager [req-b8c672c3-16bc-4b5b-be2e-0e758c1ba2cf req-6edc926d-ca42-4759-8bdf-979e46a35553 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Neutron deleted interface 0643c7ae-df24-43ff-8a02-2d4bd1f1cb39; detaching it from the instance and deleting it from the info cache
Jul 25 10:06:43 user nova-compute[71312]: DEBUG nova.network.neutron [req-b8c672c3-16bc-4b5b-be2e-0e758c1ba2cf req-6edc926d-ca42-4759-8bdf-979e46a35553 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:06:43 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Took 0.90 seconds to deallocate network for instance.
Jul 25 10:06:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8c672c3-16bc-4b5b-be2e-0e758c1ba2cf req-6edc926d-ca42-4759-8bdf-979e46a35553 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Detach interface failed, port_id=0643c7ae-df24-43ff-8a02-2d4bd1f1cb39, reason: Instance 50f8683d-8b60-4095-9507-a969c37f85e2 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:06:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:44 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:06:44 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:06:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-c31c5101-fd22-42d4-8b77-135936fac811 req-25b362a0-6075-44da-897a-c25092a8c304 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Received event network-vif-plugged-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c31c5101-fd22-42d4-8b77-135936fac811 req-25b362a0-6075-44da-897a-c25092a8c304 service nova] Acquiring lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c31c5101-fd22-42d4-8b77-135936fac811 req-25b362a0-6075-44da-897a-c25092a8c304 service nova] Lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c31c5101-fd22-42d4-8b77-135936fac811 req-25b362a0-6075-44da-897a-c25092a8c304 service nova] Lock "50f8683d-8b60-4095-9507-a969c37f85e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-c31c5101-fd22-42d4-8b77-135936fac811 req-25b362a0-6075-44da-897a-c25092a8c304 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] No waiting events found dispatching network-vif-plugged-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:06:44 user nova-compute[71312]: WARNING nova.compute.manager [req-c31c5101-fd22-42d4-8b77-135936fac811 req-25b362a0-6075-44da-897a-c25092a8c304 service nova] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Received unexpected event network-vif-plugged-0643c7ae-df24-43ff-8a02-2d4bd1f1cb39 for instance with vm_state deleted and task_state None.
Jul 25 10:06:44 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Deleted allocations for instance 50f8683d-8b60-4095-9507-a969c37f85e2
Jul 25 10:06:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3abe8c1c-b257-4365-9ec4-9b7fb6677dd2 tempest-VolumesAdminNegativeTest-692637044 tempest-VolumesAdminNegativeTest-692637044-project-member] Lock "50f8683d-8b60-4095-9507-a969c37f85e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.553s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_power_states {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 5823c859-058e-4b2f-91b0-0e4def11bebf {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 8216c52e-c0a7-42b1-9766-7bcffa376b28 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 999efbaf-c2e1-40bc-a952-c65d2ce9a47c {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 9be175c2-20a4-45ce-85a7-ee3c406a4b1f {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "5823c859-058e-4b2f-91b0-0e4def11bebf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-9ac42f8b-6a21-48a7-a44a-2fd4ace2a753 req-c37ed126-2b35-42c7-b959-29ef98e03d84 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received event network-changed-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-9ac42f8b-6a21-48a7-a44a-2fd4ace2a753 req-c37ed126-2b35-42c7-b959-29ef98e03d84 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Refreshing instance network info cache due to event network-changed-af6ee907-1823-4491-b764-5f935bcccc39. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9ac42f8b-6a21-48a7-a44a-2fd4ace2a753 req-c37ed126-2b35-42c7-b959-29ef98e03d84 service nova] Acquiring lock "refresh_cache-999efbaf-c2e1-40bc-a952-c65d2ce9a47c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9ac42f8b-6a21-48a7-a44a-2fd4ace2a753 req-c37ed126-2b35-42c7-b959-29ef98e03d84 service nova] Acquired lock "refresh_cache-999efbaf-c2e1-40bc-a952-c65d2ce9a47c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-9ac42f8b-6a21-48a7-a44a-2fd4ace2a753 req-c37ed126-2b35-42c7-b959-29ef98e03d84 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Refreshing network info cache for port af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lazy-loading 'flavor' on Instance uuid 999efbaf-c2e1-40bc-a952-c65d2ce9a47c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:06:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Attaching volume 043b1a7a-1808-4f9e-acd1-d63005d6de3f to /dev/vdb
Jul 25 10:06:56 user nova-compute[71312]: DEBUG os_brick.utils [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bcda0a-726f-4b74-b0d9-46eb7c388e29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fbd6d7-346f-40dd-96f7-8b9fac3a8693]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98614ef-4fed-483b-84fb-bdf76a9d7346]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fd73cc-bc9f-4462-bf8c-f7c90352ad47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-9ac42f8b-6a21-48a7-a44a-2fd4ace2a753 req-c37ed126-2b35-42c7-b959-29ef98e03d84 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Updated VIF entry in instance network info cache for port af6ee907-1823-4491-b764-5f935bcccc39. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-9ac42f8b-6a21-48a7-a44a-2fd4ace2a753 req-c37ed126-2b35-42c7-b959-29ef98e03d84 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Updating instance_info_cache with network_info: [{"id": "af6ee907-1823-4491-b764-5f935bcccc39", "address": "fa:16:3e:80:bd:76", "network": {"id": "8630c9a5-68e0-4e8f-99c6-3db501a1788f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1102930524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1503c144127642369fc6df38c3da51ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6ee907-18", "ovs_interfaceid": "af6ee907-1823-4491-b764-5f935bcccc39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9ac42f8b-6a21-48a7-a44a-2fd4ace2a753 req-c37ed126-2b35-42c7-b959-29ef98e03d84 service nova] Releasing lock "refresh_cache-999efbaf-c2e1-40bc-a952-c65d2ce9a47c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:06:56 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:06:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[491a8fc6-0738-4bd6-8093-af63e6f02740]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG os_brick.utils [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:06:56 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Updating existing volume attachment record: 17962fab-48cd-432a-95bf-fd76d8965f12 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:06:57 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279602.6505203, 50f8683d-8b60-4095-9507-a969c37f85e2 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:06:57 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] VM Stopped (Lifecycle Event)
Jul 25 10:06:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bdb34142-83ad-4cc1-ab23-c41c838003f1 None None] [instance: 50f8683d-8b60-4095-9507-a969c37f85e2] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:06:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:06:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:00 user nova-compute[71312]: INFO nova.compute.manager [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Attaching volume 5f4c9480-af16-4b48-9883-48618f5055d2 to /dev/vdb
Jul 25 10:07:00 user nova-compute[71312]: DEBUG os_brick.utils [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[99884c9f-645c-4395-967a-84eb911be3b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[07794b63-3d02-4222-9d3b-efdbf6517484]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8e91d3-82e4-4e0e-969b-f4ce1cf2839e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3073f8-3898-4ce6-bae4-b0d5434b4d99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:07:00 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:07:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8edfd5-2cb9-4de9-bf96-8ae45025fc85]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG os_brick.utils [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:07:00 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Updating existing volume attachment record: 8c06c247-9784-4257-a0ba-ddd2359af113 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:07:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbROPpdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:07:03 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:07:03 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:07:03 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0fa10a-521f-4643-9984-4417f1688160]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:07:03 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aac1a3e-494b-41a0-96b0-4230334e6e1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f] added
Jul 25 10:07:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[df51841e-54c1-45a9-914f-4b7c875148bf]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9276fd-cd70-4919-8a9b-48d2608870d1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VbROPpdA {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VbROPpdA" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1f09b0-c539-4822-948e-37bc47dce8ba]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VbROPpdA'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d761552d-c0bd-4f5a-b585-530a6819b0a5]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:03 user nova-compute[71312]: INFO nova.compute.manager [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Detaching volume 2616108b-d5a6-4bec-a913-8f7858013120
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f130d19-cb51-4558-8453-22a9976c45f0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:03 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:07:03 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:03 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:03 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:07:03 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:03 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:03 user nova-compute[71312]: INFO nova.virt.block_device [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Attempting to driver detach volume 2616108b-d5a6-4bec-a913-8f7858013120 from mountpoint /dev/vdb
Jul 25 10:07:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Attempting to detach device vdb from instance cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:07:03 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:07:03 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:07:03 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:07:03 user nova-compute[71312]:   <serial>2616108b-d5a6-4bec-a913-8f7858013120</serial>
Jul 25 10:07:03 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:07:03 user nova-compute[71312]: </disk>
Jul 25 10:07:03 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[17692e4d-7523-4a15-9ac0-279e1f346438]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260]
Jul 25 10:07:03 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260] successful.
Jul 25 10:07:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Successfully detached device vdb from instance cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 from the persistent domain config.
Jul 25 10:07:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:07:03 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:07:03 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:07:03 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:07:03 user nova-compute[71312]:   <serial>2616108b-d5a6-4bec-a913-8f7858013120</serial>
Jul 25 10:07:03 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:07:03 user nova-compute[71312]: </disk>
Jul 25 10:07:03 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a87f3-14bc-4d06-b96f-b445a9cf4c40]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e1d08f-396f-48fb-a4b4-7de9eb0ec92e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:03 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:07:03 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:03 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:03 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:03 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:07:03 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:03 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:03 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[160d913a-43e6-48be-b589-a2bfb550d0c7]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:07:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbROPpdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279624.1668248, cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:07:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Successfully detached device vdb from instance cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 from the live domain config.
Jul 25 10:07:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUxINHur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:07:04 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26561363539323161', 'path': '/dev/sde'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561363539323161', 'path': '/dev/sde'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.606s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lazy-loading 'flavor' on Instance uuid 999efbaf-c2e1-40bc-a952-c65d2ce9a47c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29c7afb-7faf-4999-a969-a504fbd7cc57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:07:04 user nova-compute[71312]: No targets found.
Jul 25 10:07:04 user nova-compute[71312]: iSNS:
Jul 25 10:07:04 user nova-compute[71312]: No targets found.
Jul 25 10:07:04 user nova-compute[71312]: STATIC:
Jul 25 10:07:04 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac
Jul 25 10:07:04 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:04 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:04 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f
Jul 25 10:07:04 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:04 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:04 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:07:04 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:04 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:04 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670
Jul 25 10:07:04 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:04 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:04 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120
Jul 25 10:07:04 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:04 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:04 user nova-compute[71312]: FIRMWARE:
Jul 25 10:07:04 user nova-compute[71312]: No targets found.
Jul 25 10:07:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:07:04 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:07:04 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:07:04 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:07:04 user nova-compute[71312]:   <source dev="/dev/sde"/>
Jul 25 10:07:04 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:07:04 user nova-compute[71312]:   <serial>043b1a7a-1808-4f9e-acd1-d63005d6de3f</serial>
Jul 25 10:07:04 user nova-compute[71312]: </disk>
Jul 25 10:07:04 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc8419f-e209-410b-b0e0-73d5b742eb41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d0d197-e2e8-430b-b533-da8722d89894]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:04 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:07:04 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:04 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:04 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:04 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 (non-flash)
Jul 25 10:07:04 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:04 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:04 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c0166c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa353b43-caf8-4a48-9d5f-eb9f56f14463]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8015eeda-5fdf-48d7-b6a2-bcfe1a99b23e]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dabd63-9164-4d01-a120-37400a336ce8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e598c08-6b14-457f-8f9c-50664bbe7b14]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:07:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4227d5d4-223c-40e6-9340-c5167113e05b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[63476128-b964-402b-9ae6-bef7897d6e1b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120, portal: 172.16.0.220,3260]
Jul 25 10:07:05 user nova-compute[71312]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120, portal: 172.16.0.220,3260] successful.
Jul 25 10:07:05 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2616108b-d5a6-4bec-a913-8f7858013120 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dfda25-927a-49e0-a82a-727227cc5c81]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] <== disconnect_volume: return (940ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] No VIF found with MAC fa:16:3e:80:bd:76, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce8ac82c-7823-4ed2-95d6-45d213da8910 tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lazy-loading 'flavor' on Instance uuid cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9160e396-b6d0-4d63-b093-c3df45df4750 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.358s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG os_brick.utils [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8bbc34-ce15-4ffb-98e9-803447402f47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[72df6bb6-571a-49a4-b64d-b28621f042dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d0e5c3-ba46-46a2-9e31-0bf30dff82bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc074205-0ac1-4f43-85b7-43122029c604]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:07:06 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:07:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[838db88f-d043-45da-a050-2ec71d9d4441]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:07:06 user nova-compute[71312]: DEBUG os_brick.utils [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:07:06 user nova-compute[71312]: INFO nova.compute.manager [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Swapping volume 043b1a7a-1808-4f9e-acd1-d63005d6de3f for 7a9e6a68-5d3c-4784-91ea-643f434e3b68
Jul 25 10:07:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-65194458-f9bf-4e6f-b162-b834e95c5a96 req-9639ecfd-8b95-4e98-bbc5-5ec3c2ebeb87 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-changed-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-65194458-f9bf-4e6f-b162-b834e95c5a96 req-9639ecfd-8b95-4e98-bbc5-5ec3c2ebeb87 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Refreshing instance network info cache due to event network-changed-bd177392-3e41-4cbf-b629-68a33265fae2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-65194458-f9bf-4e6f-b162-b834e95c5a96 req-9639ecfd-8b95-4e98-bbc5-5ec3c2ebeb87 service nova] Acquiring lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-65194458-f9bf-4e6f-b162-b834e95c5a96 req-9639ecfd-8b95-4e98-bbc5-5ec3c2ebeb87 service nova] Acquired lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-65194458-f9bf-4e6f-b162-b834e95c5a96 req-9639ecfd-8b95-4e98-bbc5-5ec3c2ebeb87 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Refreshing network info cache for port bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TJfgsIoc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:07:07 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:07:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:07:07 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:07:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:07:07 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6828039d-e6d3-4732-b035-c116a8e3840c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:07:07 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[548e6ec2-fda6-43ed-bcf8-635107da4e6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2] added
Jul 25 10:07:07 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cd97ad-19d4-4f09-9818-872deedd0de9]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[893ac10a-2bb1-4fd8-b162-78142a3a662a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TJfgsIoc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TJfgsIoc" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca3aa0f-1cda-4e42-9873-8d31c7300b12]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TJfgsIoc'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb699319-b909-47ed-99dc-1317553a9f51]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d54a47-2ea7-451b-b9e3-1ffc9a3c6fc7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:07 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:07 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:07 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:07 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:07 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:07 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:07 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:07 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-65194458-f9bf-4e6f-b162-b834e95c5a96 req-9639ecfd-8b95-4e98-bbc5-5ec3c2ebeb87 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Updated VIF entry in instance network info cache for port bd177392-3e41-4cbf-b629-68a33265fae2. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:07:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-65194458-f9bf-4e6f-b162-b834e95c5a96 req-9639ecfd-8b95-4e98-bbc5-5ec3c2ebeb87 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Updating instance_info_cache with network_info: [{"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-65194458-f9bf-4e6f-b162-b834e95c5a96 req-9639ecfd-8b95-4e98-bbc5-5ec3c2ebeb87 service nova] Releasing lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[216a4a5c-6826-4e28-9125-e9640d8438d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2, portal: 172.16.0.220,3260]
Jul 25 10:07:08 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2, portal: 172.16.0.220,3260] successful.
Jul 25 10:07:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d6b425-34b9-4eec-b383-7530841eac1e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cf73a6-30a4-40f4-a4c2-3736c8366f74]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:08 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:08 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:08 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:08 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 (non-flash)
Jul 25 10:07:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:08 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:08 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:08 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:08 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 (non-flash)
Jul 25 10:07:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[451ca8dd-aa27-47b5-b3e5-9da36810eefe]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:07:09 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:07:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TJfgsIoc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:07:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:07:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26437393430356561', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:07:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437393430356561', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:07:09 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:07:09 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:07:09 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:07:09 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:07:09 user nova-compute[71312]:   <serial>5f4c9480-af16-4b48-9883-48618f5055d2</serial>
Jul 25 10:07:09 user nova-compute[71312]: </disk>
Jul 25 10:07:09 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:07:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:07:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:07:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] No VIF found with MAC fa:16:3e:30:3b:71, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:07:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4fb16ec-ff0a-4ef4-8e43-992abad4a4d0 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.242s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:11 user nova-compute[71312]: INFO nova.compute.manager [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Shelving
Jul 25 10:07:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:11 user nova-compute[71312]: INFO nova.compute.manager [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Detaching volume 5f4c9480-af16-4b48-9883-48618f5055d2
Jul 25 10:07:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-738b1305-57fd-4a67-a6d5-973a8d025e6b req-bcf4525b-11c0-485e-a954-ceebd54f8ec1 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-vif-unplugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-738b1305-57fd-4a67-a6d5-973a8d025e6b req-bcf4525b-11c0-485e-a954-ceebd54f8ec1 service nova] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-738b1305-57fd-4a67-a6d5-973a8d025e6b req-bcf4525b-11c0-485e-a954-ceebd54f8ec1 service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-738b1305-57fd-4a67-a6d5-973a8d025e6b req-bcf4525b-11c0-485e-a954-ceebd54f8ec1 service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-738b1305-57fd-4a67-a6d5-973a8d025e6b req-bcf4525b-11c0-485e-a954-ceebd54f8ec1 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] No waiting events found dispatching network-vif-unplugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:07:11 user nova-compute[71312]: WARNING nova.compute.manager [req-738b1305-57fd-4a67-a6d5-973a8d025e6b req-bcf4525b-11c0-485e-a954-ceebd54f8ec1 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received unexpected event network-vif-unplugged-bd177392-3e41-4cbf-b629-68a33265fae2 for instance with vm_state active and task_state shelving.
Jul 25 10:07:11 user nova-compute[71312]: INFO nova.virt.block_device [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Attempting to driver detach volume 5f4c9480-af16-4b48-9883-48618f5055d2 from mountpoint /dev/vdb
Jul 25 10:07:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Attempting to detach device vdb from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:07:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:07:11 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:07:11 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:07:11 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:07:11 user nova-compute[71312]:   <serial>5f4c9480-af16-4b48-9883-48618f5055d2</serial>
Jul 25 10:07:11 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:07:11 user nova-compute[71312]: </disk>
Jul 25 10:07:11 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:07:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Successfully detached device vdb from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the persistent domain config.
Jul 25 10:07:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:07:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:07:11 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:07:11 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:07:11 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:07:11 user nova-compute[71312]:   <serial>5f4c9480-af16-4b48-9883-48618f5055d2</serial>
Jul 25 10:07:11 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:07:11 user nova-compute[71312]: </disk>
Jul 25 10:07:11 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279632.5754821, 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:07:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Successfully detached device vdb from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the live domain config.
Jul 25 10:07:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TJfgsIoc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:07:12 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Instance destroyed successfully.
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc413e1d-bb93-4adf-807d-2debd9f15f2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:07:12 user nova-compute[71312]: No targets found.
Jul 25 10:07:12 user nova-compute[71312]: iSNS:
Jul 25 10:07:12 user nova-compute[71312]: No targets found.
Jul 25 10:07:12 user nova-compute[71312]: STATIC:
Jul 25 10:07:12 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac
Jul 25 10:07:12 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:12 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:12 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f
Jul 25 10:07:12 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:12 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:12 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:07:12 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:12 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:12 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670
Jul 25 10:07:12 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:12 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:12 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2
Jul 25 10:07:12 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:12 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:12 user nova-compute[71312]: FIRMWARE:
Jul 25 10:07:12 user nova-compute[71312]: No targets found.
Jul 25 10:07:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:07:12 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:07:12 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b4673a-9e45-4e22-8123-b86e898ffbb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Beginning cold snapshot process
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.084s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a5f550-02ea-472f-abe8-692c09ec84f8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:12 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:12 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:12 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:12 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 (non-flash)
Jul 25 10:07:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:12 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:12 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:12 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:12 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 (non-flash)
Jul 25 10:07:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c0134160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e9511c-e5a5-4877-ac8f-3ada5c4cdc4b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[863d49a1-a773-44c9-9bc2-09c023d98d8c]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[864d743d-b076-4842-9245-3ff055c10196]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d99177c-f504-4a01-9d1f-dafcab46b5aa]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b203ba-8177-4961-8634-6324f70fed9c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk /opt/stack/data/nova/instances/snapshots/tmp8evkg_kx/ef96887db6144ad3a4387f0fa57d0d86 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.110s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f1c19e-bf53-43b5-bb15-8291939c400e]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2, portal: 172.16.0.220,3260]
Jul 25 10:07:13 user nova-compute[71312]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2, portal: 172.16.0.220,3260] successful.
Jul 25 10:07:13 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4c9480-af16-4b48-9883-48618f5055d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.060s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c125473-bfee-40fa-a084-5ed8452df731]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.619s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] <== disconnect_volume: return (621ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:13 user nova-compute[71312]: INFO nova.compute.manager [None req-b88f5915-2b9e-4f20-940b-297c91d25d56 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Unrescuing
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b88f5915-2b9e-4f20-940b-297c91d25d56 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b88f5915-2b9e-4f20-940b-297c91d25d56 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquired lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b88f5915-2b9e-4f20-940b-297c91d25d56 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] No waiting events found dispatching network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:07:13 user nova-compute[71312]: WARNING nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received unexpected event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 for instance with vm_state active and task_state shelving_image_pending_upload.
Jul 25 10:07:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] No waiting events found dispatching network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:07:13 user nova-compute[71312]: WARNING nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received unexpected event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 for instance with vm_state active and task_state shelving_image_pending_upload.
Jul 25 10:07:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] No waiting events found dispatching network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:07:13 user nova-compute[71312]: WARNING nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received unexpected event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 for instance with vm_state active and task_state shelving_image_pending_upload.
Jul 25 10:07:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-vif-unplugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] No waiting events found dispatching network-vif-unplugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:07:13 user nova-compute[71312]: WARNING nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received unexpected event network-vif-unplugged-bd177392-3e41-4cbf-b629-68a33265fae2 for instance with vm_state active and task_state shelving_image_pending_upload.
Jul 25 10:07:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] No waiting events found dispatching network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:07:13 user nova-compute[71312]: WARNING nova.compute.manager [req-0bd8e196-0799-43c7-9f5a-946584a34d88 req-868a0a60-724c-40fc-9780-f4a1c940235b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received unexpected event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 for instance with vm_state active and task_state shelving_image_pending_upload.
Jul 25 10:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk /opt/stack/data/nova/instances/snapshots/tmp8evkg_kx/ef96887db6144ad3a4387f0fa57d0d86" returned: 0 in 0.976s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:13 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Snapshot extracted, beginning image upload
Jul 25 10:07:14 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b88f5915-2b9e-4f20-940b-297c91d25d56 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Updating instance_info_cache with network_info: [{"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b88f5915-2b9e-4f20-940b-297c91d25d56 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Releasing lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b88f5915-2b9e-4f20-940b-297c91d25d56 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'flavor' on Instance uuid 8216c52e-c0a7-42b1-9766-7bcffa376b28 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOyTlegz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '999efbaf-c2e1-40bc-a952-c65d2ce9a47c', 'attached_at': '', 'detached_at': '', 'volume_id': '7a9e6a68-5d3c-4784-91ea-643f434e3b68', 'serial': '7a9e6a68-5d3c-4784-91ea-643f434e3b68'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbROPpdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '999efbaf-c2e1-40bc-a952-c65d2ce9a47c', 'attached_at': '', 'detached_at': '', 'volume_id': '043b1a7a-1808-4f9e-acd1-d63005d6de3f', 'serial'} {{(pid=71312) _swap_volume /opt/stack/nova/nova/compute/manager.py:7686}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOyTlegz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:07:14 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:07:14 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:07:14 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0c83fa-42ea-447c-8e09-9e9246dbcd6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:07:14 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b511551-2e0c-4226-b260-d744c082f1cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68] added
Jul 25 10:07:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG nova.objects.instance [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[63945d69-602e-457b-872e-dbef19510c47]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6533add7-4820-48e8-80f7-f2d990707f6c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wOyTlegz {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-50db65f6-11c8-4101-b501-4fc7cc8ee93e tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.562s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wOyTlegz" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b50f5f-8404-4bc7-93e3-2d863d44eaf9]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wOyTlegz'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9d6801-4c0a-4fb6-ba96-781e0acb60b5]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cca388d-7c05-401d-977a-6138845ab479]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:14 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:14 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:14 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:14 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:14 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:14 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[22690441-3f60-4816-911c-8c8c786ecaa1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68, portal: 172.16.0.220,3260]
Jul 25 10:07:14 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68, portal: 172.16.0.220,3260] successful.
Jul 25 10:07:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-94a6c5b2-d806-4080-9e4b-f1abfbd8fbd6 req-f4a31242-e25f-4415-bc40-09cc8bfa71d7 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-vif-unplugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-94a6c5b2-d806-4080-9e4b-f1abfbd8fbd6 req-f4a31242-e25f-4415-bc40-09cc8bfa71d7 service nova] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-94a6c5b2-d806-4080-9e4b-f1abfbd8fbd6 req-f4a31242-e25f-4415-bc40-09cc8bfa71d7 service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-94a6c5b2-d806-4080-9e4b-f1abfbd8fbd6 req-f4a31242-e25f-4415-bc40-09cc8bfa71d7 service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-94a6c5b2-d806-4080-9e4b-f1abfbd8fbd6 req-f4a31242-e25f-4415-bc40-09cc8bfa71d7 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] No waiting events found dispatching network-vif-unplugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:07:14 user nova-compute[71312]: WARNING nova.compute.manager [req-94a6c5b2-d806-4080-9e4b-f1abfbd8fbd6 req-f4a31242-e25f-4415-bc40-09cc8bfa71d7 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received unexpected event network-vif-unplugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[332c77e6-2a76-4723-a45e-7790befe45de]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[04de1d3f-1ab8-4b49-bde8-36a4991f9b15]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:14 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:14 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:14 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:14 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)
Jul 25 10:07:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:14 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:14 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:14 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:14 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)
Jul 25 10:07:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.058s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da9784e-6bf4-4e69-8124-d71164f14d9f]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:07:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOyTlegz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:07:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Instance destroyed successfully.
Jul 25 10:07:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:07:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23462363832363466', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:07:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462363832363466', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:07:15 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lazy-loading 'flavor' on Instance uuid 999efbaf-c2e1-40bc-a952-c65d2ce9a47c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 13631488 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-7cd31094-d682-4392-8156-40ba6c8141ab req-75de6262-8700-4b99-a219-b9130c345494 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7cd31094-d682-4392-8156-40ba6c8141ab req-75de6262-8700-4b99-a219-b9130c345494 service nova] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7cd31094-d682-4392-8156-40ba6c8141ab req-75de6262-8700-4b99-a219-b9130c345494 service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7cd31094-d682-4392-8156-40ba6c8141ab req-75de6262-8700-4b99-a219-b9130c345494 service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-7cd31094-d682-4392-8156-40ba6c8141ab req-75de6262-8700-4b99-a219-b9130c345494 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] No waiting events found dispatching network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:07:16 user nova-compute[71312]: WARNING nova.compute.manager [req-7cd31094-d682-4392-8156-40ba6c8141ab req-75de6262-8700-4b99-a219-b9130c345494 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received unexpected event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:07:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Snapshot image upload complete
Jul 25 10:07:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:07:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 189792256 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:17 user nova-compute[71312]: INFO nova.compute.manager [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Shelve offloading
Jul 25 10:07:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Instance destroyed successfully.
Jul 25 10:07:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:07:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:07:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquired lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:07:17 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:07:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 346030080 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 475004928 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:07:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:07:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Updating instance_info_cache with network_info: [{"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:07:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Releasing lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:07:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 610271232 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-d4e75503-3e39-4c5e-afb9-2abf40b19d21 req-bc173d8b-8445-4b79-acf1-61018fd890ae service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d4e75503-3e39-4c5e-afb9-2abf40b19d21 req-bc173d8b-8445-4b79-acf1-61018fd890ae service nova] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d4e75503-3e39-4c5e-afb9-2abf40b19d21 req-bc173d8b-8445-4b79-acf1-61018fd890ae service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d4e75503-3e39-4c5e-afb9-2abf40b19d21 req-bc173d8b-8445-4b79-acf1-61018fd890ae service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-d4e75503-3e39-4c5e-afb9-2abf40b19d21 req-bc173d8b-8445-4b79-acf1-61018fd890ae service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] No waiting events found dispatching network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:07:18 user nova-compute[71312]: WARNING nova.compute.manager [req-d4e75503-3e39-4c5e-afb9-2abf40b19d21 req-bc173d8b-8445-4b79-acf1-61018fd890ae service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received unexpected event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:07:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-d4e75503-3e39-4c5e-afb9-2abf40b19d21 req-bc173d8b-8445-4b79-acf1-61018fd890ae service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d4e75503-3e39-4c5e-afb9-2abf40b19d21 req-bc173d8b-8445-4b79-acf1-61018fd890ae service nova] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d4e75503-3e39-4c5e-afb9-2abf40b19d21 req-bc173d8b-8445-4b79-acf1-61018fd890ae service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d4e75503-3e39-4c5e-afb9-2abf40b19d21 req-bc173d8b-8445-4b79-acf1-61018fd890ae service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-d4e75503-3e39-4c5e-afb9-2abf40b19d21 req-bc173d8b-8445-4b79-acf1-61018fd890ae service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] No waiting events found dispatching network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:07:18 user nova-compute[71312]: WARNING nova.compute.manager [req-d4e75503-3e39-4c5e-afb9-2abf40b19d21 req-bc173d8b-8445-4b79-acf1-61018fd890ae service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received unexpected event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:07:18 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:07:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:07:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 748683264 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Instance destroyed successfully.
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'resources' on Instance uuid 9be175c2-20a4-45ce-85a7-ee3c406a4b1f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-7ea329eb-e81f-49db-b5d3-194bbbf197ca req-4f7063ca-e812-4f39-8808-6d933dc0373b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-changed-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-7ea329eb-e81f-49db-b5d3-194bbbf197ca req-4f7063ca-e812-4f39-8808-6d933dc0373b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Refreshing instance network info cache due to event network-changed-bd177392-3e41-4cbf-b629-68a33265fae2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7ea329eb-e81f-49db-b5d3-194bbbf197ca req-4f7063ca-e812-4f39-8808-6d933dc0373b service nova] Acquiring lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7ea329eb-e81f-49db-b5d3-194bbbf197ca req-4f7063ca-e812-4f39-8808-6d933dc0373b service nova] Acquired lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.network.neutron [req-7ea329eb-e81f-49db-b5d3-194bbbf197ca req-4f7063ca-e812-4f39-8808-6d933dc0373b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Refreshing network info cache for port bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1905762448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1905762448',id=17,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvKvs8yd/NCFKkUWvMqLOY4/x6Uz25yC2jkPkcm7758dTAqRpS9uCldsrdCsLRvuo94l2rgvDVdbsWq2Cxuin+cxVAQKbFF3fhDUMd0Ge/4O05oIjQjwaOTBjiXtrVtEA==',key_name='tempest-keypair-909376568',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:05:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='23211f867d6049f5bb1901e03e8dc396',ramdisk_id='',reservation_id='r-ker0w51i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1954806993',owner_user_name='tempest-AttachVolumeShelveTestJSON-1954806993-project-member',shelved_at='2023-07-25T10:07:16.760177',shelved_host='user',shelved_image_id='4bae609f-0f7f-47c9-9c46-bb37ad8e0c9e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:07:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec3ee9c206b43448eb6479cad0b437c',uuid=9be175c2-20a4-45ce-85a7-ee3c406a4b1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converting VIF {"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:de:ac,bridge_name='br-int',has_traffic_filtering=True,id=bd177392-3e41-4cbf-b629-68a33265fae2,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd177392-3e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG os_vif [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:de:ac,bridge_name='br-int',has_traffic_filtering=True,id=bd177392-3e41-4cbf-b629-68a33265fae2,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd177392-3e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd177392-3e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:19 user nova-compute[71312]: INFO os_vif [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:de:ac,bridge_name='br-int',has_traffic_filtering=True,id=bd177392-3e41-4cbf-b629-68a33265fae2,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd177392-3e')
Jul 25 10:07:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Deleting instance files /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f_del
Jul 25 10:07:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Deletion of /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f_del complete
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 901775360 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:19 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Deleted allocations for instance 9be175c2-20a4-45ce-85a7-ee3c406a4b1f
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Removed pending event for 8216c52e-c0a7-42b1-9766-7bcffa376b28 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279639.634069, 8216c52e-c0a7-42b1-9766-7bcffa376b28 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:07:19 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] VM Resumed (Lifecycle Event)
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b88f5915-2b9e-4f20-940b-297c91d25d56 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'numa_topology' on Instance uuid 9be175c2-20a4-45ce-85a7-ee3c406a4b1f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:07:19 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279639.6411834, 8216c52e-c0a7-42b1-9766-7bcffa376b28 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:07:19 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] VM Started (Lifecycle Event)
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 1033895936 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Updating instance_info_cache with network_info: [{"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-7ea329eb-e81f-49db-b5d3-194bbbf197ca req-4f7063ca-e812-4f39-8808-6d933dc0373b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Updated VIF entry in instance network info cache for port bd177392-3e41-4cbf-b629-68a33265fae2. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-7ea329eb-e81f-49db-b5d3-194bbbf197ca req-4f7063ca-e812-4f39-8808-6d933dc0373b service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Updating instance_info_cache with network_info: [{"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbd177392-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7ea329eb-e81f-49db-b5d3-194bbbf197ca req-4f7063ca-e812-4f39-8808-6d933dc0373b service nova] Releasing lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9e4fc709-4920-4f59-b29f-a9f3970c0bf6 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.827s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbROPpdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:07:20 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6611b2-6416-42cb-b202-492ee8a499bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:07:20 user nova-compute[71312]: No targets found.
Jul 25 10:07:20 user nova-compute[71312]: iSNS:
Jul 25 10:07:20 user nova-compute[71312]: No targets found.
Jul 25 10:07:20 user nova-compute[71312]: STATIC:
Jul 25 10:07:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac
Jul 25 10:07:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f
Jul 25 10:07:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:07:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670
Jul 25 10:07:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68
Jul 25 10:07:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:20 user nova-compute[71312]: FIRMWARE:
Jul 25 10:07:20 user nova-compute[71312]: No targets found.
Jul 25 10:07:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:07:20 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:07:20 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f52fc0-e489-48b1-85b3-e2d3df3ba57a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb37acb1-ed29-4e27-a320-2813d13169dc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:20 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:20 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:20 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:20 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)
Jul 25 10:07:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:20 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:20 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:20 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:20 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)
Jul 25 10:07:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c0166290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f'): ({'sde'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Removing single pathed devices sde {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a227a776-475c-40c3-a709-01f6da1b5513]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[431de002-4710-41be-98b3-5e2b13cd0e62]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Flushing IO for device /dev/sde {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[de073372-327c-41fb-8334-d1916d6f47d0]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.210s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26b55ca-7bc7-4131-b36d-d1a23e336687]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[df969fca-6931-4214-80b7-2f25162b6577]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.479s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cd690f-c119-4f4e-9017-9a2c6e966b22]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260]
Jul 25 10:07:21 user nova-compute[71312]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260] successful.
Jul 25 10:07:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c0a037-5f73-4bdc-b98f-d9f2820b8043]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.929s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] <== disconnect_volume: return (930ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:07:21 user nova-compute[71312]: INFO nova.compute.claims [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Claim successful on node user
Jul 25 10:07:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOyTlegz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '999efbaf-c2e1-40bc-a952-c65d2ce9a47c', 'attached_at': '', 'detached_at': '', 'volume_id': '7a9e6a68-5d3c-4784-91ea-643f434e3b68', 'serial'} {{(pid=71312) _swap_volume /opt/stack/nova/nova/compute/manager.py:7695}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] swap_volume: removing Cinder connection for volume 043b1a7a-1808-4f9e-acd1-d63005d6de3f {{(pid=71312) _swap_volume /opt/stack/nova/nova/compute/manager.py:7740}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:07:22 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:07:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG nova.policy [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fe1a69013de4b4dbcb98a35e48d8ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a09fcc394c945c2b843abf3df53cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:07:22 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Creating image(s)
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "/opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "/opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] swap_volume: Updating volume 043b1a7a-1808-4f9e-acd1-d63005d6de3f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "wOyTlegz", "auth_password": "WFQbDwqXcYfN28", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "7a9e6a68-5d3c-4784-91ea-643f434e3b68"}, "status": "reserved", "instance": "999efbaf-c2e1-40bc-a952-c65d2ce9a47c", "attached_at": "", "detached_at": "", "volume_id": "7a9e6a68-5d3c-4784-91ea-643f434e3b68", "serial": "7a9e6a68-5d3c-4784-91ea-643f434e3b68"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7a9e6a68-5d3c-4784-91ea-643f434e3b68', 'no_device': None, 'attachment_id': '7316d244-5697-4e5b-b85d-7238af3021f7'} {{(pid=71312) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7888}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0d6ea80f-ffb3-444c-b934-1ff542dd9c8a tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.880s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk 1073741824" returned: 0 in 0.055s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Successfully created port: 504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Cannot resize image /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG nova.objects.instance [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'migration_context' on Instance uuid 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Ensure instance console log exists: /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG os_brick.utils [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b4ce85-c968-478d-829c-6fe8119051d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2de4f12-7207-4aba-8ad0-92b932a85012]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a042641-71dc-42ba-aa9f-88e1f1da78f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38249f6-2774-455d-8e7e-a3445d25280f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:07:23 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b072fa07-8824-4fa9-89c4-593613083228]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG os_brick.utils [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:07:23 user nova-compute[71312]: INFO nova.compute.manager [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Swapping volume 7a9e6a68-5d3c-4784-91ea-643f434e3b68 for 043b1a7a-1808-4f9e-acd1-d63005d6de3f
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Successfully updated port: 504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-30144d64-c82d-4019-b797-9a13f2238fa8 req-3d7eae51-2f24-4d89-b846-d9c3c1aa0763 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Received event network-changed-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-30144d64-c82d-4019-b797-9a13f2238fa8 req-3d7eae51-2f24-4d89-b846-d9c3c1aa0763 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Refreshing instance network info cache due to event network-changed-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30144d64-c82d-4019-b797-9a13f2238fa8 req-3d7eae51-2f24-4d89-b846-d9c3c1aa0763 service nova] Acquiring lock "refresh_cache-0a221b2c-60d5-4751-84c1-0f4bfbc3f303" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30144d64-c82d-4019-b797-9a13f2238fa8 req-3d7eae51-2f24-4d89-b846-d9c3c1aa0763 service nova] Acquired lock "refresh_cache-0a221b2c-60d5-4751-84c1-0f4bfbc3f303" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG nova.network.neutron [req-30144d64-c82d-4019-b797-9a13f2238fa8 req-3d7eae51-2f24-4d89-b846-d9c3c1aa0763 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Refreshing network info cache for port 504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "refresh_cache-0a221b2c-60d5-4751-84c1-0f4bfbc3f303" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG nova.network.neutron [req-30144d64-c82d-4019-b797-9a13f2238fa8 req-3d7eae51-2f24-4d89-b846-d9c3c1aa0763 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG nova.network.neutron [req-30144d64-c82d-4019-b797-9a13f2238fa8 req-3d7eae51-2f24-4d89-b846-d9c3c1aa0763 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30144d64-c82d-4019-b797-9a13f2238fa8 req-3d7eae51-2f24-4d89-b846-d9c3c1aa0763 service nova] Releasing lock "refresh_cache-0a221b2c-60d5-4751-84c1-0f4bfbc3f303" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquired lock "refresh_cache-0a221b2c-60d5-4751-84c1-0f4bfbc3f303" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:07:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.network.neutron [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Updating instance_info_cache with network_info: [{"id": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "address": "fa:16:3e:dd:c9:ee", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504a0f5e-a1", "ovs_interfaceid": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Releasing lock "refresh_cache-0a221b2c-60d5-4751-84c1-0f4bfbc3f303" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Instance network_info: |[{"id": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "address": "fa:16:3e:dd:c9:ee", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504a0f5e-a1", "ovs_interfaceid": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Start _get_guest_xml network_info=[{"id": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "address": "fa:16:3e:dd:c9:ee", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504a0f5e-a1", "ovs_interfaceid": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:07:25 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:07:25 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-16019691',display_name='tempest-AttachVolumeNegativeTest-server-16019691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-16019691',id=18,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa6BmX0sZgnnMKJlSNiZSVVUE1EbjKrVljO/6/wJp7DA6VB00mN9ek8Qwhz2H0nQNPaiF2Iz0nysXLx8PC5l5aZ9mPwNu5Pg35qsmp2kzw+NPUHtAaZRii2xvKN+h95/w==',key_name='tempest-keypair-863741174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a09fcc394c945c2b843abf3df53cda6',ramdisk_id='',reservation_id='r-uhavf33z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016049404',owner_user_name='tempest-AttachVolumeNegativeTest-1016049404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:07:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe1a69013de4b4dbcb98a35e48d8ee8',uuid=0a221b2c-60d5-4751-84c1-0f4bfbc3f303,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "address": "fa:16:3e:dd:c9:ee", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504a0f5e-a1", "ovs_interfaceid": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converting VIF {"id": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "address": "fa:16:3e:dd:c9:ee", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504a0f5e-a1", "ovs_interfaceid": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c9:ee,bridge_name='br-int',has_traffic_filtering=True,id=504a0f5e-a1d1-4925-94a1-f1a775fa3e1e,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504a0f5e-a1') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.objects.instance [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:07:25 user nova-compute[71312]:   <uuid>0a221b2c-60d5-4751-84c1-0f4bfbc3f303</uuid>
Jul 25 10:07:25 user nova-compute[71312]:   <name>instance-00000012</name>
Jul 25 10:07:25 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:07:25 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:07:25 user nova-compute[71312]:   <metadata>
Jul 25 10:07:25 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:07:25 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:07:25 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeNegativeTest-server-16019691</nova:name>
Jul 25 10:07:25 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:07:25</nova:creationTime>
Jul 25 10:07:25 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:07:25 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:07:25 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:07:25 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:07:25 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:07:25 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:07:25 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:07:25 user nova-compute[71312]:       <nova:owner>
Jul 25 10:07:25 user nova-compute[71312]:         <nova:user uuid="3fe1a69013de4b4dbcb98a35e48d8ee8">tempest-AttachVolumeNegativeTest-1016049404-project-member</nova:user>
Jul 25 10:07:25 user nova-compute[71312]:         <nova:project uuid="0a09fcc394c945c2b843abf3df53cda6">tempest-AttachVolumeNegativeTest-1016049404</nova:project>
Jul 25 10:07:25 user nova-compute[71312]:       </nova:owner>
Jul 25 10:07:25 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:07:25 user nova-compute[71312]:       <nova:ports>
Jul 25 10:07:25 user nova-compute[71312]:         <nova:port uuid="504a0f5e-a1d1-4925-94a1-f1a775fa3e1e">
Jul 25 10:07:25 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 10:07:25 user nova-compute[71312]:         </nova:port>
Jul 25 10:07:25 user nova-compute[71312]:       </nova:ports>
Jul 25 10:07:25 user nova-compute[71312]:     </nova:instance>
Jul 25 10:07:25 user nova-compute[71312]:   </metadata>
Jul 25 10:07:25 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:07:25 user nova-compute[71312]:     <system>
Jul 25 10:07:25 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:07:25 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:07:25 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:07:25 user nova-compute[71312]:       <entry name="serial">0a221b2c-60d5-4751-84c1-0f4bfbc3f303</entry>
Jul 25 10:07:25 user nova-compute[71312]:       <entry name="uuid">0a221b2c-60d5-4751-84c1-0f4bfbc3f303</entry>
Jul 25 10:07:25 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:07:25 user nova-compute[71312]:     </system>
Jul 25 10:07:25 user nova-compute[71312]:   </sysinfo>
Jul 25 10:07:25 user nova-compute[71312]:   <os>
Jul 25 10:07:25 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:07:25 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:07:25 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:07:25 user nova-compute[71312]:   </os>
Jul 25 10:07:25 user nova-compute[71312]:   <features>
Jul 25 10:07:25 user nova-compute[71312]:     <acpi/>
Jul 25 10:07:25 user nova-compute[71312]:     <apic/>
Jul 25 10:07:25 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:07:25 user nova-compute[71312]:   </features>
Jul 25 10:07:25 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:07:25 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:07:25 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:07:25 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:07:25 user nova-compute[71312]:   </clock>
Jul 25 10:07:25 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:07:25 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:07:25 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:07:25 user nova-compute[71312]:   </cpu>
Jul 25 10:07:25 user nova-compute[71312]:   <devices>
Jul 25 10:07:25 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:07:25 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:07:25 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk"/>
Jul 25 10:07:25 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:07:25 user nova-compute[71312]:     </disk>
Jul 25 10:07:25 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:07:25 user nova-compute[71312]:       <mac address="fa:16:3e:dd:c9:ee"/>
Jul 25 10:07:25 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:07:25 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:07:25 user nova-compute[71312]:       <target dev="tap504a0f5e-a1"/>
Jul 25 10:07:25 user nova-compute[71312]:     </interface>
Jul 25 10:07:25 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:07:25 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/console.log" append="off"/>
Jul 25 10:07:25 user nova-compute[71312]:     </serial>
Jul 25 10:07:25 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:07:25 user nova-compute[71312]:     <video>
Jul 25 10:07:25 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:07:25 user nova-compute[71312]:     </video>
Jul 25 10:07:25 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:07:25 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:07:25 user nova-compute[71312]:     </rng>
Jul 25 10:07:25 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:07:25 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:07:25 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:07:25 user nova-compute[71312]:     </memballoon>
Jul 25 10:07:25 user nova-compute[71312]:   </devices>
Jul 25 10:07:25 user nova-compute[71312]: </domain>
Jul 25 10:07:25 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-16019691',display_name='tempest-AttachVolumeNegativeTest-server-16019691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-16019691',id=18,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa6BmX0sZgnnMKJlSNiZSVVUE1EbjKrVljO/6/wJp7DA6VB00mN9ek8Qwhz2H0nQNPaiF2Iz0nysXLx8PC5l5aZ9mPwNu5Pg35qsmp2kzw+NPUHtAaZRii2xvKN+h95/w==',key_name='tempest-keypair-863741174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a09fcc394c945c2b843abf3df53cda6',ramdisk_id='',reservation_id='r-uhavf33z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016049404',owner_user_name='tempest-AttachVolumeNegativeTest-1016049404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:07:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe1a69013de4b4dbcb98a35e48d8ee8',uuid=0a221b2c-60d5-4751-84c1-0f4bfbc3f303,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "address": "fa:16:3e:dd:c9:ee", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504a0f5e-a1", "ovs_interfaceid": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converting VIF {"id": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "address": "fa:16:3e:dd:c9:ee", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504a0f5e-a1", "ovs_interfaceid": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c9:ee,bridge_name='br-int',has_traffic_filtering=True,id=504a0f5e-a1d1-4925-94a1-f1a775fa3e1e,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504a0f5e-a1') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG os_vif [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c9:ee,bridge_name='br-int',has_traffic_filtering=True,id=504a0f5e-a1d1-4925-94a1-f1a775fa3e1e,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504a0f5e-a1') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap504a0f5e-a1, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap504a0f5e-a1, col_values=(('external_ids', {'iface-id': '504a0f5e-a1d1-4925-94a1-f1a775fa3e1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:c9:ee', 'vm-uuid': '0a221b2c-60d5-4751-84c1-0f4bfbc3f303'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:25 user nova-compute[71312]: INFO os_vif [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c9:ee,bridge_name='br-int',has_traffic_filtering=True,id=504a0f5e-a1d1-4925-94a1-f1a775fa3e1e,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504a0f5e-a1')
Jul 25 10:07:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No VIF found with MAC fa:16:3e:dd:c9:ee, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:07:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:07:29 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279649.5450425, 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:07:29 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] VM Resumed (Lifecycle Event)
Jul 25 10:07:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279632.5885062, 9be175c2-20a4-45ce-85a7-ee3c406a4b1f => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:07:30 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] VM Stopped (Lifecycle Event)
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-b7aff093-c3ff-4a5c-a8e0-ca5850487106 req-81ab4bb8-e209-4e6f-9841-1ae1d101709d service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Received event network-vif-plugged-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b7aff093-c3ff-4a5c-a8e0-ca5850487106 req-81ab4bb8-e209-4e6f-9841-1ae1d101709d service nova] Acquiring lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b7aff093-c3ff-4a5c-a8e0-ca5850487106 req-81ab4bb8-e209-4e6f-9841-1ae1d101709d service nova] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b7aff093-c3ff-4a5c-a8e0-ca5850487106 req-81ab4bb8-e209-4e6f-9841-1ae1d101709d service nova] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-b7aff093-c3ff-4a5c-a8e0-ca5850487106 req-81ab4bb8-e209-4e6f-9841-1ae1d101709d service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] No waiting events found dispatching network-vif-plugged-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:07:30 user nova-compute[71312]: WARNING nova.compute.manager [req-b7aff093-c3ff-4a5c-a8e0-ca5850487106 req-81ab4bb8-e209-4e6f-9841-1ae1d101709d service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Received unexpected event network-vif-plugged-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e for instance with vm_state building and task_state spawning.
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-b642378f-70a7-420b-973d-467f1116ad46 req-955d89ba-dcef-46f6-a1cf-16ced40f81b9 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Received event network-vif-plugged-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b642378f-70a7-420b-973d-467f1116ad46 req-955d89ba-dcef-46f6-a1cf-16ced40f81b9 service nova] Acquiring lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b642378f-70a7-420b-973d-467f1116ad46 req-955d89ba-dcef-46f6-a1cf-16ced40f81b9 service nova] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b642378f-70a7-420b-973d-467f1116ad46 req-955d89ba-dcef-46f6-a1cf-16ced40f81b9 service nova] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-b642378f-70a7-420b-973d-467f1116ad46 req-955d89ba-dcef-46f6-a1cf-16ced40f81b9 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] No waiting events found dispatching network-vif-plugged-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:07:30 user nova-compute[71312]: WARNING nova.compute.manager [req-b642378f-70a7-420b-973d-467f1116ad46 req-955d89ba-dcef-46f6-a1cf-16ced40f81b9 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Received unexpected event network-vif-plugged-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e for instance with vm_state building and task_state spawning.
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-07e6fd9e-5853-4662-9ef9-37b91f644976 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:07:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Instance spawned successfully.
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:07:30 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:07:30 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7625MB free_disk=25.28173065185547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:30 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279649.5453568, 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:07:30 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] VM Started (Lifecycle Event)
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:07:30 user nova-compute[71312]: INFO nova.compute.manager [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Detaching volume 9bca412d-abf2-4775-898b-4dc48badc670
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:07:30 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:07:30 user nova-compute[71312]: INFO nova.compute.manager [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Took 8.08 seconds to spawn the instance on the hypervisor.
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:07:30 user nova-compute[71312]: INFO nova.virt.block_device [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Attempting to driver detach volume 9bca412d-abf2-4775-898b-4dc48badc670 from mountpoint /dev/vdb
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9fb85501-6210-4bfd-b496-1891c79fd23c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 999efbaf-c2e1-40bc-a952-c65d2ce9a47c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Attempting to detach device vdb from instance bcc93774-32b0-4592-bf6a-d655bac21d39 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:07:30 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:07:30 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:07:30 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:07:30 user nova-compute[71312]:   <serial>9bca412d-abf2-4775-898b-4dc48badc670</serial>
Jul 25 10:07:30 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 10:07:30 user nova-compute[71312]: </disk>
Jul 25 10:07:30 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:07:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Successfully detached device vdb from instance bcc93774-32b0-4592-bf6a-d655bac21d39 from the persistent domain config.
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bcc93774-32b0-4592-bf6a-d655bac21d39 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:07:30 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:07:30 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:07:30 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:07:30 user nova-compute[71312]:   <serial>9bca412d-abf2-4775-898b-4dc48badc670</serial>
Jul 25 10:07:30 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 10:07:30 user nova-compute[71312]: </disk>
Jul 25 10:07:30 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:07:30 user nova-compute[71312]: INFO nova.compute.manager [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Took 8.86 seconds to build instance.
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cf0d0919-7089-45e8-a20e-de6d0b9fa62a tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.620s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279650.745601, bcc93774-32b0-4592-bf6a-d655bac21d39 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:07:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Successfully detached device vdb from instance bcc93774-32b0-4592-bf6a-d655bac21d39 from the live domain config.
Jul 25 10:07:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEIBehbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:07:30 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[447f34c5-a253-481f-ae07-1e794a11ace6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:07:30 user nova-compute[71312]: No targets found.
Jul 25 10:07:30 user nova-compute[71312]: iSNS:
Jul 25 10:07:30 user nova-compute[71312]: No targets found.
Jul 25 10:07:30 user nova-compute[71312]: STATIC:
Jul 25 10:07:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac
Jul 25 10:07:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:07:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670
Jul 25 10:07:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68
Jul 25 10:07:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:30 user nova-compute[71312]: FIRMWARE:
Jul 25 10:07:30 user nova-compute[71312]: No targets found.
Jul 25 10:07:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:07:30 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:07:30 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13e82a4-81d4-404d-a1ce-5ad821c81f04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a438068-1619-4ddf-95c6-2051907a12eb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:30 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:30 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:30 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)
Jul 25 10:07:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:30 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 (non-flash)
Jul 25 10:07:30 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:30 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)
Jul 25 10:07:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a842d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670'): ({'sdg'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Removing single pathed devices sdg {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5391cb4e-edc1-4a43-a9d7-94fb6ffaa6ed]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d91f49-780d-4fb4-8daa-da149e47d6c8]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Flushing IO for device /dev/sdg {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c38427-f4be-41db-be51-2b835534d322]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b2ad35-dd99-421a-8d32-a3d69c0961c8]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:07:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a5a228-9c5e-4bf7-bca0-f5463bcc958f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7f0158-d1e1-44d3-a616-31d28b80a05d]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260]
Jul 25 10:07:31 user nova-compute[71312]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670, portal: 172.16.0.220,3260] successful.
Jul 25 10:07:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bca412d-abf2-4775-898b-4dc48badc670 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f44b25-005d-44c4-896f-2325fcc9490a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] <== disconnect_volume: return (335ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbROPpdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '999efbaf-c2e1-40bc-a952-c65d2ce9a47c', 'attached_at': '', 'detached_at': '', 'volume_id': '043b1a7a-1808-4f9e-acd1-d63005d6de3f', 'serial': '043b1a7a-1808-4f9e-acd1-d63005d6de3f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOyTlegz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '7a9e6a68-5d3c-4784-91ea-643f434e3b68'}, 'status': 'reserved', 'instance': '999efbaf-c2e1-40bc-a952-c65d2ce9a47c', 'attached_at': '', 'detached_at': '', 'volume_id': '7a9e6a68-5d3c-4784-91ea-643f434e3b68', 'serial'} {{(pid=71312) _swap_volume /opt/stack/nova/nova/compute/manager.py:7686}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbROPpdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:07:31 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:07:31 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:07:31 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aba78b-93b8-4e51-8f17-663f60f28776]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:07:31 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f763d0-1da2-4403-b84f-cc725e67d2a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f] added
Jul 25 10:07:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[98efede1-c806-4667-b4dc-98a9e5d27062]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1576aee-e12f-4069-baaa-9fa08898fbcd]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VbROPpdA {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VbROPpdA" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[46600d81-a1d3-4a92-934f-cdaab9e92d9b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VbROPpdA'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e754df2e-3e9b-41ec-86db-41243698b36c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc9b4ad-cecb-46d6-9324-bd3dbcff3cf6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:31 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:31 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)
Jul 25 10:07:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:31 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:31 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)
Jul 25 10:07:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b45e0d7-ae77-4860-bb69-45b4592b183f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260]
Jul 25 10:07:31 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260] successful.
Jul 25 10:07:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[768ec567-5f1d-40ba-b84b-27074df7be15]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f5638d-7ec9-4a18-9ab4-6d1af657039a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:31 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:31 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)
Jul 25 10:07:31 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:31 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:31 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)
Jul 25 10:07:31 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[381a5c9d-6cb9-4d53-a518-495b9a3e2760]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:07:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbROPpdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:07:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'flavor' on Instance uuid bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab7feb5c-4b6e-49a1-aeb2-5bf194fc47d5 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.952s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:07:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26561363539323161', 'path': '/dev/sde'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:07:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561363539323161', 'path': '/dev/sde'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:07:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lazy-loading 'flavor' on Instance uuid 999efbaf-c2e1-40bc-a952-c65d2ce9a47c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 89128960 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 261095424 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 430964736 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 605028352 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 769654784 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 937426944 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:07:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:07:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOyTlegz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '7a9e6a68-5d3c-4784-91ea-643f434e3b68'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:07:36 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:07:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:07:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:07:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd01557f-f372-4561-99ab-e83ec6204117]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:07:36 user nova-compute[71312]: No targets found.
Jul 25 10:07:36 user nova-compute[71312]: iSNS:
Jul 25 10:07:36 user nova-compute[71312]: No targets found.
Jul 25 10:07:36 user nova-compute[71312]: STATIC:
Jul 25 10:07:36 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac
Jul 25 10:07:36 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:36 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:36 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f
Jul 25 10:07:36 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:36 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:36 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:07:36 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:36 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:36 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68
Jul 25 10:07:36 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:36 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:36 user nova-compute[71312]: FIRMWARE:
Jul 25 10:07:36 user nova-compute[71312]: No targets found.
Jul 25 10:07:36 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:07:36 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:07:36 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:07:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:07:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[356768e8-d62a-4e2e-bd59-2e990b3e1235]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[895b585c-d040-4bff-a68e-c493eef83e21]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:37 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:37 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)
Jul 25 10:07:37 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:37 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:37 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 (non-flash)
Jul 25 10:07:37 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c029b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[398c089c-fd81-43ae-89b3-5c5382f32a02]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf8f437-9669-43a6-bb21-c89890fde9d9]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd61948-1218-4748-aa9f-814937e7327d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b366ca-e2bd-4dc1-b3ed-7dd48c3480bc]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d615af-84be-42a8-985f-de3141e566a0]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dd6ee7-ce01-4088-9a97-223613827b5a]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68, portal: 172.16.0.220,3260]
Jul 25 10:07:37 user nova-compute[71312]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68, portal: 172.16.0.220,3260] successful.
Jul 25 10:07:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9e6a68-5d3c-4784-91ea-643f434e3b68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c990ce4d-bcee-41a6-973d-22a1394601d2]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] <== disconnect_volume: return (336ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbROPpdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '999efbaf-c2e1-40bc-a952-c65d2ce9a47c', 'attached_at': '', 'detached_at': '', 'volume_id': '043b1a7a-1808-4f9e-acd1-d63005d6de3f', 'serial'} {{(pid=71312) _swap_volume /opt/stack/nova/nova/compute/manager.py:7695}}
Jul 25 10:07:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] swap_volume: removing Cinder connection for volume 7a9e6a68-5d3c-4784-91ea-643f434e3b68 {{(pid=71312) _swap_volume /opt/stack/nova/nova/compute/manager.py:7740}}
Jul 25 10:07:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] swap_volume: Updating volume 7a9e6a68-5d3c-4784-91ea-643f434e3b68 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "VbROPpdA", "auth_password": "X9gf2n3bLqpvIE", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "043b1a7a-1808-4f9e-acd1-d63005d6de3f"}, "status": "reserved", "instance": "999efbaf-c2e1-40bc-a952-c65d2ce9a47c", "attached_at": "", "detached_at": "", "volume_id": "043b1a7a-1808-4f9e-acd1-d63005d6de3f", "serial": "043b1a7a-1808-4f9e-acd1-d63005d6de3f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '043b1a7a-1808-4f9e-acd1-d63005d6de3f', 'no_device': None, 'attachment_id': 'f4eca2ad-d6af-4196-bb66-cd959c964340'} {{(pid=71312) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7888}}
Jul 25 10:07:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c323c9f-9e43-43cd-9cf5-bf46c3cd1b51 tempest-TestVolumeSwap-1285842867 tempest-TestVolumeSwap-1285842867-project-admin] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.591s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:39 user nova-compute[71312]: INFO nova.compute.manager [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Detaching volume 043b1a7a-1808-4f9e-acd1-d63005d6de3f
Jul 25 10:07:39 user nova-compute[71312]: INFO nova.virt.block_device [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Attempting to driver detach volume 043b1a7a-1808-4f9e-acd1-d63005d6de3f from mountpoint /dev/vdb
Jul 25 10:07:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Attempting to detach device vdb from instance 999efbaf-c2e1-40bc-a952-c65d2ce9a47c from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:07:39 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:07:39 user nova-compute[71312]:   <source dev="/dev/sde"/>
Jul 25 10:07:39 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:07:39 user nova-compute[71312]:   <serial>043b1a7a-1808-4f9e-acd1-d63005d6de3f</serial>
Jul 25 10:07:39 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:07:39 user nova-compute[71312]: </disk>
Jul 25 10:07:39 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:07:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Successfully detached device vdb from instance 999efbaf-c2e1-40bc-a952-c65d2ce9a47c from the persistent domain config.
Jul 25 10:07:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 999efbaf-c2e1-40bc-a952-c65d2ce9a47c from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:07:39 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:07:39 user nova-compute[71312]:   <source dev="/dev/sde"/>
Jul 25 10:07:39 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:07:39 user nova-compute[71312]:   <serial>043b1a7a-1808-4f9e-acd1-d63005d6de3f</serial>
Jul 25 10:07:39 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:07:39 user nova-compute[71312]: </disk>
Jul 25 10:07:39 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279659.7376463, 999efbaf-c2e1-40bc-a952-c65d2ce9a47c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 999efbaf-c2e1-40bc-a952-c65d2ce9a47c {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:07:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Successfully detached device vdb from instance 999efbaf-c2e1-40bc-a952-c65d2ce9a47c from the live domain config.
Jul 25 10:07:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbROPpdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '043b1a7a-1808-4f9e-acd1-d63005d6de3f'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:07:39 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e6081c-aab0-4bbc-8b7e-ec95609893d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:07:39 user nova-compute[71312]: No targets found.
Jul 25 10:07:39 user nova-compute[71312]: iSNS:
Jul 25 10:07:39 user nova-compute[71312]: No targets found.
Jul 25 10:07:39 user nova-compute[71312]: STATIC:
Jul 25 10:07:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac
Jul 25 10:07:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:39 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f
Jul 25 10:07:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:39 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:07:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:07:39 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:07:39 user nova-compute[71312]: FIRMWARE:
Jul 25 10:07:39 user nova-compute[71312]: No targets found.
Jul 25 10:07:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:07:39 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:07:39 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb583241-5e14-438e-84fa-c8f85a93eeb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[42608c94-b908-44b3-a8f2-6b54c5b56533]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:39 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:39 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:07:39 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:07:39 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f (non-flash)
Jul 25 10:07:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c0259a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f'): ({'sde'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Removing single pathed devices sde {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b64d0a-3d75-40ae-a975-6a8a96ab0751]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b091a8d-00d2-4516-b641-a759400f3a37]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Flushing IO for device /dev/sde {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[00498cdc-37f4-4ea5-8f7a-81d3a589176c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e7f458-9bc9-4991-bdd3-a0d57f76662f]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2db01c0-b252-4582-ae06-7ff2fae1d66e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7053db0-de09-4d52-9fd5-d841319ccbcd]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260]
Jul 25 10:07:40 user nova-compute[71312]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f, portal: 172.16.0.220,3260] successful.
Jul 25 10:07:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:07:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b1a7a-1808-4f9e-acd1-d63005d6de3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:07:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c8ccd4-5c74-4edc-9e82-4364bcce61e7]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:07:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:07:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:07:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] <== disconnect_volume: return (321ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:07:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:07:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lazy-loading 'flavor' on Instance uuid 999efbaf-c2e1-40bc-a952-c65d2ce9a47c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f4b8a152-acf6-41eb-970c-35aa7107036d tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.661s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:07:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:07:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:07:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:07:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:58 user nova-compute[71312]: INFO nova.compute.manager [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Terminating instance
Jul 25 10:07:58 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-c76b5858-69a2-484f-aba7-46289a1d3435 req-35a0f4b7-87fc-4778-8411-1ce82660238a service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-vif-unplugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c76b5858-69a2-484f-aba7-46289a1d3435 req-35a0f4b7-87fc-4778-8411-1ce82660238a service nova] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c76b5858-69a2-484f-aba7-46289a1d3435 req-35a0f4b7-87fc-4778-8411-1ce82660238a service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c76b5858-69a2-484f-aba7-46289a1d3435 req-35a0f4b7-87fc-4778-8411-1ce82660238a service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-c76b5858-69a2-484f-aba7-46289a1d3435 req-35a0f4b7-87fc-4778-8411-1ce82660238a service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] No waiting events found dispatching network-vif-unplugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:07:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-c76b5858-69a2-484f-aba7-46289a1d3435 req-35a0f4b7-87fc-4778-8411-1ce82660238a service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-vif-unplugged-63f89ec1-70e3-4e23-ad25-c0f935da374d for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:07:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Instance destroyed successfully.
Jul 25 10:07:59 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lazy-loading 'resources' on Instance uuid cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:07:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-154077661',display_name='tempest-ServerStableDeviceRescueTest-server-154077661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-154077661',id=7,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5DPaESDCeTpFbLJiK3piM5EU6CqyhywiQ6G6M7018kXvUoCeKIYBjx8qywJTsbdrwNXxHLDnFEpNN/Njz3QJ803HXAV1pUHCs8Upben7DXi3URXH+EDpuvsOogdBIbWA==',key_name='tempest-keypair-2033571811',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:04:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dda42819655247c4bd852a6e41edeb69',ramdisk_id='',reservation_id='r-vhaos4q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-430984902',owner_user_name='tempest-ServerStableDeviceRescueTest-430984902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:06:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e2c8d915c3f4fdd8056f8b8651a6b79',uuid=cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:07:59 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Converting VIF {"id": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "address": "fa:16:3e:77:36:b8", "network": {"id": "ec35bc41-dfd0-49c6-a731-3d750841e2b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-880572271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda42819655247c4bd852a6e41edeb69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f89ec1-70", "ovs_interfaceid": "63f89ec1-70e3-4e23-ad25-c0f935da374d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:07:59 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:36:b8,bridge_name='br-int',has_traffic_filtering=True,id=63f89ec1-70e3-4e23-ad25-c0f935da374d,network=Network(ec35bc41-dfd0-49c6-a731-3d750841e2b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f89ec1-70') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:07:59 user nova-compute[71312]: DEBUG os_vif [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:36:b8,bridge_name='br-int',has_traffic_filtering=True,id=63f89ec1-70e3-4e23-ad25-c0f935da374d,network=Network(ec35bc41-dfd0-49c6-a731-3d750841e2b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f89ec1-70') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:07:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63f89ec1-70, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:07:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:07:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:07:59 user nova-compute[71312]: INFO os_vif [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:36:b8,bridge_name='br-int',has_traffic_filtering=True,id=63f89ec1-70e3-4e23-ad25-c0f935da374d,network=Network(ec35bc41-dfd0-49c6-a731-3d750841e2b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f89ec1-70')
Jul 25 10:07:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Deleting instance files /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1_del
Jul 25 10:07:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Deletion of /opt/stack/data/nova/instances/cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1_del complete
Jul 25 10:07:59 user nova-compute[71312]: INFO nova.compute.manager [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 25 10:07:59 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:07:59 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:07:59 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:08:00 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:08:00 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Took 1.16 seconds to deallocate network for instance.
Jul 25 10:08:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-997a9e20-0441-4cb9-9588-4e3ecae7088f req-d2f39d31-d85a-47b4-969a-4942eafa8ea6 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-997a9e20-0441-4cb9-9588-4e3ecae7088f req-d2f39d31-d85a-47b4-969a-4942eafa8ea6 service nova] Acquiring lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-997a9e20-0441-4cb9-9588-4e3ecae7088f req-d2f39d31-d85a-47b4-969a-4942eafa8ea6 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-997a9e20-0441-4cb9-9588-4e3ecae7088f req-d2f39d31-d85a-47b4-969a-4942eafa8ea6 service nova] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-997a9e20-0441-4cb9-9588-4e3ecae7088f req-d2f39d31-d85a-47b4-969a-4942eafa8ea6 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] No waiting events found dispatching network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:01 user nova-compute[71312]: WARNING nova.compute.manager [req-997a9e20-0441-4cb9-9588-4e3ecae7088f req-d2f39d31-d85a-47b4-969a-4942eafa8ea6 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received unexpected event network-vif-plugged-63f89ec1-70e3-4e23-ad25-c0f935da374d for instance with vm_state deleted and task_state None.
Jul 25 10:08:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-997a9e20-0441-4cb9-9588-4e3ecae7088f req-d2f39d31-d85a-47b4-969a-4942eafa8ea6 service nova] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Received event network-vif-deleted-63f89ec1-70e3-4e23-ad25-c0f935da374d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:01 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:08:01 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:01 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Deleted allocations for instance cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1
Jul 25 10:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1cb8e309-8044-4907-9f14-544262265939 tempest-ServerStableDeviceRescueTest-430984902 tempest-ServerStableDeviceRescueTest-430984902-project-member] Lock "cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.699s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:07 user nova-compute[71312]: INFO nova.compute.manager [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Attaching volume e349e81d-e4c2-49af-8f13-9def32795b67 to /dev/vdb
Jul 25 10:08:07 user nova-compute[71312]: DEBUG os_brick.utils [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2160a716-4957-4542-a74e-1f417d197c04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca8e62e-f28f-4476-b7fd-a133df5aec79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f840f395-e705-4c39-b8a6-7eba5861fcc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa0c50f-55b3-4e41-b85c-611d81a39953]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:08:07 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:08:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4297258-27cd-469c-9b1a-c94760100267]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG os_brick.utils [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:08:07 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Updating existing volume attachment record: eb06665e-fcfc-4a7b-9aae-078e8d67ebb2 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:08:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'flavor' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:08:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:08:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquired lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:08:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:08:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'info_cache' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.network.neutron [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Updating instance_info_cache with network_info: [{"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Releasing lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:08:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Instance destroyed successfully.
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.objects.instance [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'resources' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-144544124',display_name='tempest-AttachVolumeTestJSON-server-144544124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-144544124',id=1,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXz0IZaYzGqFbEgiNbRhFKdSJm7XWgEwVt5cEq+cvPNuokJAodyfDggfS0UAjnFMJC0mA942niA5C8O8meI4xtkMoQ/wHBJsXHFttAfgGOUxF17NM8ZbF6FsKSU7eOZoQ==',key_name='tempest-keypair-2122772756',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='68cb9228183844d5853c6c2a35f2658f',ramdisk_id='',reservation_id='r-il07codx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095711794',owner_user_name='tempest-AttachVolumeTestJSON-1095711794-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:06:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48272d2a58644b2b8b6a9c42b51c746',uuid=a35abe6a-0a8b-4eb2-8781-85b99539d1fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converting VIF {"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG os_vif [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8954e08-0e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:12 user nova-compute[71312]: INFO os_vif [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e')
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Start _get_guest_xml network_info=[{"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.objects.instance [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'numa_topology' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:08:12 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:08:12 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.objects.instance [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'vcpu_model' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-144544124',display_name='tempest-AttachVolumeTestJSON-server-144544124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-144544124',id=1,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXz0IZaYzGqFbEgiNbRhFKdSJm7XWgEwVt5cEq+cvPNuokJAodyfDggfS0UAjnFMJC0mA942niA5C8O8meI4xtkMoQ/wHBJsXHFttAfgGOUxF17NM8ZbF6FsKSU7eOZoQ==',key_name='tempest-keypair-2122772756',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='68cb9228183844d5853c6c2a35f2658f',ramdisk_id='',reservation_id='r-il07codx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095711794',owner_user_name='tempest-AttachVolumeTestJSON-1095711794-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:06:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48272d2a58644b2b8b6a9c42b51c746',uuid=a35abe6a-0a8b-4eb2-8781-85b99539d1fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converting VIF {"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.objects.instance [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'pci_devices' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:08:12 user nova-compute[71312]:   <uuid>a35abe6a-0a8b-4eb2-8781-85b99539d1fc</uuid>
Jul 25 10:08:12 user nova-compute[71312]:   <name>instance-00000001</name>
Jul 25 10:08:12 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:08:12 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:08:12 user nova-compute[71312]:   <metadata>
Jul 25 10:08:12 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:08:12 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:08:12 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeTestJSON-server-144544124</nova:name>
Jul 25 10:08:12 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:08:12</nova:creationTime>
Jul 25 10:08:12 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:08:12 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:08:12 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:08:12 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:08:12 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:08:12 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:08:12 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:08:12 user nova-compute[71312]:       <nova:owner>
Jul 25 10:08:12 user nova-compute[71312]:         <nova:user uuid="c48272d2a58644b2b8b6a9c42b51c746">tempest-AttachVolumeTestJSON-1095711794-project-member</nova:user>
Jul 25 10:08:12 user nova-compute[71312]:         <nova:project uuid="68cb9228183844d5853c6c2a35f2658f">tempest-AttachVolumeTestJSON-1095711794</nova:project>
Jul 25 10:08:12 user nova-compute[71312]:       </nova:owner>
Jul 25 10:08:12 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:08:12 user nova-compute[71312]:       <nova:ports>
Jul 25 10:08:12 user nova-compute[71312]:         <nova:port uuid="c8954e08-0e8d-41ae-9080-1eb363124b32">
Jul 25 10:08:12 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 10:08:12 user nova-compute[71312]:         </nova:port>
Jul 25 10:08:12 user nova-compute[71312]:       </nova:ports>
Jul 25 10:08:12 user nova-compute[71312]:     </nova:instance>
Jul 25 10:08:12 user nova-compute[71312]:   </metadata>
Jul 25 10:08:12 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:08:12 user nova-compute[71312]:     <system>
Jul 25 10:08:12 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:08:12 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:08:12 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:08:12 user nova-compute[71312]:       <entry name="serial">a35abe6a-0a8b-4eb2-8781-85b99539d1fc</entry>
Jul 25 10:08:12 user nova-compute[71312]:       <entry name="uuid">a35abe6a-0a8b-4eb2-8781-85b99539d1fc</entry>
Jul 25 10:08:12 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:08:12 user nova-compute[71312]:     </system>
Jul 25 10:08:12 user nova-compute[71312]:   </sysinfo>
Jul 25 10:08:12 user nova-compute[71312]:   <os>
Jul 25 10:08:12 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:08:12 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:08:12 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:08:12 user nova-compute[71312]:   </os>
Jul 25 10:08:12 user nova-compute[71312]:   <features>
Jul 25 10:08:12 user nova-compute[71312]:     <acpi/>
Jul 25 10:08:12 user nova-compute[71312]:     <apic/>
Jul 25 10:08:12 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:08:12 user nova-compute[71312]:   </features>
Jul 25 10:08:12 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:08:12 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:08:12 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:08:12 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:08:12 user nova-compute[71312]:   </clock>
Jul 25 10:08:12 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:08:12 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:08:12 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:08:12 user nova-compute[71312]:   </cpu>
Jul 25 10:08:12 user nova-compute[71312]:   <devices>
Jul 25 10:08:12 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:08:12 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:08:12 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk"/>
Jul 25 10:08:12 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:08:12 user nova-compute[71312]:     </disk>
Jul 25 10:08:12 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:08:12 user nova-compute[71312]:       <mac address="fa:16:3e:3d:6d:80"/>
Jul 25 10:08:12 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:08:12 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:08:12 user nova-compute[71312]:       <target dev="tapc8954e08-0e"/>
Jul 25 10:08:12 user nova-compute[71312]:     </interface>
Jul 25 10:08:12 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:08:12 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/console.log" append="off"/>
Jul 25 10:08:12 user nova-compute[71312]:     </serial>
Jul 25 10:08:12 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:08:12 user nova-compute[71312]:     <video>
Jul 25 10:08:12 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:08:12 user nova-compute[71312]:     </video>
Jul 25 10:08:12 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:08:12 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:08:12 user nova-compute[71312]:     </rng>
Jul 25 10:08:12 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:08:12 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:08:12 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:08:12 user nova-compute[71312]:     </memballoon>
Jul 25 10:08:12 user nova-compute[71312]:   </devices>
Jul 25 10:08:12 user nova-compute[71312]: </domain>
Jul 25 10:08:12 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.objects.instance [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'trusted_certs' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:08:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Cannot resize image /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG nova.objects.instance [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'migration_context' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-144544124',display_name='tempest-AttachVolumeTestJSON-server-144544124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-144544124',id=1,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXz0IZaYzGqFbEgiNbRhFKdSJm7XWgEwVt5cEq+cvPNuokJAodyfDggfS0UAjnFMJC0mA942niA5C8O8meI4xtkMoQ/wHBJsXHFttAfgGOUxF17NM8ZbF6FsKSU7eOZoQ==',key_name='tempest-keypair-2122772756',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='68cb9228183844d5853c6c2a35f2658f',ramdisk_id='',reservation_id='r-il07codx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095711794',owner_user_name='tempest-AttachVolumeTestJSON-1095711794-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:06:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48272d2a58644b2b8b6a9c42b51c746',uuid=a35abe6a-0a8b-4eb2-8781-85b99539d1fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converting VIF {"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG os_vif [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8954e08-0e, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8954e08-0e, col_values=(('external_ids', {'iface-id': 'c8954e08-0e8d-41ae-9080-1eb363124b32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:6d:80', 'vm-uuid': 'a35abe6a-0a8b-4eb2-8781-85b99539d1fc'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:13 user nova-compute[71312]: INFO os_vif [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e')
Jul 25 10:08:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDBIFfcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:08:13 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:08:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:08:13 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:08:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:08:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:08:13 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:08:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b2fcd7-9451-4c48-bfc3-53a1956d3283]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:08:14 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9febe4e6-05ea-40cf-abfe-e6127e98dab9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67] added
Jul 25 10:08:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbd3355-4184-4314-9077-c61530e68938]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ee113b-4010-4a5d-b770-864bea254eb9]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZDBIFfcT {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZDBIFfcT" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c10694-6fb0-49f3-8b78-c1ed593941dc]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZDBIFfcT'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b022cc-641e-4343-93f0-baa9fb89b8a3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c11205-af4b-442b-85d1-1ac958093cd2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:14 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:14 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[16180574-b4b8-4108-bfa3-271abbc37742]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67, portal: 172.16.0.220,3260]
Jul 25 10:08:14 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67, portal: 172.16.0.220,3260] successful.
Jul 25 10:08:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db1ed23-dd27-4049-aaf4-51fd8e413ed4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b97882-d548-4c77-98c7-a41ceb1cf764]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:14 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:14 user nova-compute[71312]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 (non-flash)
Jul 25 10:08:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:14 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:14 user nova-compute[71312]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 (non-flash)
Jul 25 10:08:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b1c337-54e6-40fe-a120-14597b47b632]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDBIFfcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279679.3603709, cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:08:14 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] VM Stopped (Lifecycle Event)
Jul 25 10:08:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-113ef758-9e34-454e-b0a8-72043754f30d None None] [instance: cf3bfac1-e9a3-4c66-a104-deb9cf52b9a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:08:14 user nova-compute[71312]: INFO nova.compute.claims [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Claim successful on node user
Jul 25 10:08:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-294598d8-d08a-4da1-b763-b237c18c1581 req-de63b7a5-920c-4f22-91c6-debc16c7e547 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-294598d8-d08a-4da1-b763-b237c18c1581 req-de63b7a5-920c-4f22-91c6-debc16c7e547 service nova] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-294598d8-d08a-4da1-b763-b237c18c1581 req-de63b7a5-920c-4f22-91c6-debc16c7e547 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-294598d8-d08a-4da1-b763-b237c18c1581 req-de63b7a5-920c-4f22-91c6-debc16c7e547 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-294598d8-d08a-4da1-b763-b237c18c1581 req-de63b7a5-920c-4f22-91c6-debc16c7e547 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] No waiting events found dispatching network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:14 user nova-compute[71312]: WARNING nova.compute.manager [req-294598d8-d08a-4da1-b763-b237c18c1581 req-de63b7a5-920c-4f22-91c6-debc16c7e547 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received unexpected event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 for instance with vm_state stopped and task_state powering-on.
Jul 25 10:08:15 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:08:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:08:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:08:15 user nova-compute[71312]: INFO nova.virt.block_device [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Booting with volume 307e9899-abfd-4370-a46e-da0f8d160087 at /dev/vda
Jul 25 10:08:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23132343066623132', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132343066623132', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG os_brick.utils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:08:15 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:08:15 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:08:15 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:08:15 user nova-compute[71312]:   <serial>e349e81d-e4c2-49af-8f13-9def32795b67</serial>
Jul 25 10:08:15 user nova-compute[71312]: </disk>
Jul 25 10:08:15 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfb2a7f-3dbe-4e0a-89f4-ed40151c203b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a29624-ae5e-4515-a16a-371ce765b29a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG nova.policy [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3407a2faec4343109bf84e1e7337af07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949c208a6b7c45ff9469fd3b39b560bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[840e1445-3b47-48ca-99a9-fe6828d586ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce67f38-c2ed-4738-b0da-67b496acb03e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:08:15 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac8b307-4c01-4639-b8ea-e6c358fbe3fa]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG os_brick.utils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updating existing volume attachment record: 74742e7f-36f1-4efe-8b09-221e7ab35a47 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] No VIF found with MAC fa:16:3e:30:3b:71, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:08:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3e15ab7-29a2-4b7b-ab47-e9369b2a31d7 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.761s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:16 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279696.6374614, a35abe6a-0a8b-4eb2-8781-85b99539d1fc => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:08:16 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] VM Resumed (Lifecycle Event)
Jul 25 10:08:16 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Successfully created port: 99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:08:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:08:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Instance rebooted successfully.
Jul 25 10:08:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-173e59d3-1a5f-475b-9c3a-04a161607cf6 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:08:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:08:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:08:16 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 25 10:08:16 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279696.6382365, a35abe6a-0a8b-4eb2-8781-85b99539d1fc => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:08:16 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] VM Started (Lifecycle Event)
Jul 25 10:08:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:08:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:08:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-e9839e14-6417-4730-8d0b-2fabebd3a08f req-efa5033d-9841-4f23-ae8e-e11208365490 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e9839e14-6417-4730-8d0b-2fabebd3a08f req-efa5033d-9841-4f23-ae8e-e11208365490 service nova] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e9839e14-6417-4730-8d0b-2fabebd3a08f req-efa5033d-9841-4f23-ae8e-e11208365490 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e9839e14-6417-4730-8d0b-2fabebd3a08f req-efa5033d-9841-4f23-ae8e-e11208365490 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-e9839e14-6417-4730-8d0b-2fabebd3a08f req-efa5033d-9841-4f23-ae8e-e11208365490 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] No waiting events found dispatching network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:16 user nova-compute[71312]: WARNING nova.compute.manager [req-e9839e14-6417-4730-8d0b-2fabebd3a08f req-efa5033d-9841-4f23-ae8e-e11208365490 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received unexpected event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 for instance with vm_state active and task_state None.
Jul 25 10:08:17 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Successfully created port: 2eee5f90-639a-4724-9758-0689e4548963 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:08:17 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Successfully created port: 7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:18 user nova-compute[71312]: INFO nova.compute.manager [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Detaching volume e349e81d-e4c2-49af-8f13-9def32795b67
Jul 25 10:08:18 user nova-compute[71312]: INFO nova.virt.block_device [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Attempting to driver detach volume e349e81d-e4c2-49af-8f13-9def32795b67 from mountpoint /dev/vdb
Jul 25 10:08:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Attempting to detach device vdb from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:08:18 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:08:18 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:08:18 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:08:18 user nova-compute[71312]:   <serial>e349e81d-e4c2-49af-8f13-9def32795b67</serial>
Jul 25 10:08:18 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:08:18 user nova-compute[71312]: </disk>
Jul 25 10:08:18 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:08:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Successfully detached device vdb from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the persistent domain config.
Jul 25 10:08:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:08:18 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:08:18 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:08:18 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:08:18 user nova-compute[71312]:   <serial>e349e81d-e4c2-49af-8f13-9def32795b67</serial>
Jul 25 10:08:18 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:08:18 user nova-compute[71312]: </disk>
Jul 25 10:08:18 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Successfully created port: 40f11c7c-09cf-4b21-acb5-a6281b4421ec {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279698.9432003, 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:08:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Successfully detached device vdb from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the live domain config.
Jul 25 10:08:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDBIFfcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:08:18 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:08:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[251f37f8-c29a-46af-97a2-baddb286bd1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:08:18 user nova-compute[71312]: No targets found.
Jul 25 10:08:18 user nova-compute[71312]: iSNS:
Jul 25 10:08:18 user nova-compute[71312]: No targets found.
Jul 25 10:08:18 user nova-compute[71312]: STATIC:
Jul 25 10:08:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac
Jul 25 10:08:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:08:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:08:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:08:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:08:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:08:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67
Jul 25 10:08:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:08:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:08:18 user nova-compute[71312]: FIRMWARE:
Jul 25 10:08:18 user nova-compute[71312]: No targets found.
Jul 25 10:08:18 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:08:18 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:08:18 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:08:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a72f1e-ed7b-4cef-938c-661ca4116af9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b2030b-d329-4fe9-b29e-30e16293d87b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:19 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:19 user nova-compute[71312]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 (non-flash)
Jul 25 10:08:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:19 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:19 user nova-compute[71312]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 (non-flash)
Jul 25 10:08:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c03d9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3993e6a5-bd84-47ea-b921-f1b9eccf154c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6c6ed3-8f19-436e-b704-ae9a9903bef6]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea85f176-1ce3-4406-917d-92499ee716d7]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae8de6f-9cce-4d34-8eb5-825f3ab2f4f1]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dd0fcb-270a-40c3-b307-2feeca2b6733]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00ab6e1-4846-43a9-b582-9af8d1eee46f]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67, portal: 172.16.0.220,3260]
Jul 25 10:08:19 user nova-compute[71312]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67, portal: 172.16.0.220,3260] successful.
Jul 25 10:08:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e349e81d-e4c2-49af-8f13-9def32795b67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0e2e94-6ac0-40db-8ac8-10b27bf3b3e7]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] <== disconnect_volume: return (344ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Successfully created port: 4ca21dc2-4954-40eb-81b9-de0d4d91c08c {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:08:20 user nova-compute[71312]: DEBUG nova.objects.instance [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:08:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-72ed4760-74d3-4541-b4e5-452343ef3b46 tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.747s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Successfully updated port: 99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:08:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-8c362f43-8f5a-413d-920f-c5276706f661 req-d0d7b1b9-0fd9-41b6-9644-fcc0de2a2282 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-changed-99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-8c362f43-8f5a-413d-920f-c5276706f661 req-d0d7b1b9-0fd9-41b6-9644-fcc0de2a2282 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing instance network info cache due to event network-changed-99d7dcea-66cf-481f-9032-88bc7ca0f945. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:08:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8c362f43-8f5a-413d-920f-c5276706f661 req-d0d7b1b9-0fd9-41b6-9644-fcc0de2a2282 service nova] Acquiring lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:08:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8c362f43-8f5a-413d-920f-c5276706f661 req-d0d7b1b9-0fd9-41b6-9644-fcc0de2a2282 service nova] Acquired lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:08:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-8c362f43-8f5a-413d-920f-c5276706f661 req-d0d7b1b9-0fd9-41b6-9644-fcc0de2a2282 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing network info cache for port 99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:08:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-8c362f43-8f5a-413d-920f-c5276706f661 req-d0d7b1b9-0fd9-41b6-9644-fcc0de2a2282 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:08:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-8c362f43-8f5a-413d-920f-c5276706f661 req-d0d7b1b9-0fd9-41b6-9644-fcc0de2a2282 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:08:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8c362f43-8f5a-413d-920f-c5276706f661 req-d0d7b1b9-0fd9-41b6-9644-fcc0de2a2282 service nova] Releasing lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:08:21 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Successfully updated port: 59952b1f-a979-435c-b62a-121d29086ca8 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Successfully updated port: 303d5eaf-9f56-46f8-a525-38e786edba0f {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:08:22 user nova-compute[71312]: INFO nova.virt.block_device [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Booting with volume f2e66dab-75fe-4f24-9045-d554eac9ccd8 at /dev/vdb
Jul 25 10:08:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-changed-59952b1f-a979-435c-b62a-121d29086ca8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing instance network info cache due to event network-changed-59952b1f-a979-435c-b62a-121d29086ca8. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] Acquiring lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] Acquired lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing network info cache for port 59952b1f-a979-435c-b62a-121d29086ca8 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG os_brick.utils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20dc17a-5305-4377-a7a3-bdfa05b0f744]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a908ac93-27c1-4efb-a358-d7172a8753f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[da10fcdc-734e-45aa-a26e-978d2d7a1dff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce07939-4052-48e2-94ba-4019b999f2b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:08:22 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[840bcfbf-d665-47bd-94e4-622aca9b4752]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG os_brick.utils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updating existing volume attachment record: 4489e57d-936b-4199-bfae-21aae056b01d {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] Releasing lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-changed-303d5eaf-9f56-46f8-a525-38e786edba0f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing instance network info cache due to event network-changed-303d5eaf-9f56-46f8-a525-38e786edba0f. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] Acquiring lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] Acquired lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing network info cache for port 303d5eaf-9f56-46f8-a525-38e786edba0f {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Successfully updated port: 2eee5f90-639a-4724-9758-0689e4548963 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:08:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:08:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:23 user nova-compute[71312]: DEBUG nova.network.neutron [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:08:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d3f9eda-3556-4a1b-8292-1a8932315638 req-ac769a30-9e76-4373-aa61-950a8fe4986f service nova] Releasing lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:08:23 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Successfully updated port: 7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Successfully updated port: 40f11c7c-09cf-4b21-acb5-a6281b4421ec {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:08:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-changed-2eee5f90-639a-4724-9758-0689e4548963 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing instance network info cache due to event network-changed-2eee5f90-639a-4724-9758-0689e4548963. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] Acquiring lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] Acquired lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing network info cache for port 2eee5f90-639a-4724-9758-0689e4548963 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] Releasing lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-changed-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing instance network info cache due to event network-changed-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] Acquiring lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] Acquired lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing network info cache for port 7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Successfully updated port: 4ca21dc2-4954-40eb-81b9-de0d4d91c08c {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] Releasing lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-changed-40f11c7c-09cf-4b21-acb5-a6281b4421ec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing instance network info cache due to event network-changed-40f11c7c-09cf-4b21-acb5-a6281b4421ec. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] Acquiring lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] Acquired lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing network info cache for port 40f11c7c-09cf-4b21-acb5-a6281b4421ec {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG nova.network.neutron [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec900179-03c1-4d75-8fa1-6cd4b02fbadc req-b85fee22-23ad-4aaa-a835-c539bd830983 service nova] Releasing lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquired lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-197c0455-0b71-4a33-876a-6d005e652ce3 req-e487cb9c-1694-4877-bc6d-f0b270879e20 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-changed-4ca21dc2-4954-40eb-81b9-de0d4d91c08c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-197c0455-0b71-4a33-876a-6d005e652ce3 req-e487cb9c-1694-4877-bc6d-f0b270879e20 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing instance network info cache due to event network-changed-4ca21dc2-4954-40eb-81b9-de0d4d91c08c. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-197c0455-0b71-4a33-876a-6d005e652ce3 req-e487cb9c-1694-4877-bc6d-f0b270879e20 service nova] Acquiring lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:08:27 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:08:27 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7699MB free_disk=25.365093231201172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9fb85501-6210-4bfd-b496-1891c79fd23c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 999efbaf-c2e1-40bc-a952-c65d2ce9a47c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 3a5a9026-70f9-42fd-b8f8-66fc893ced35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:08:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:08:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:28 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:08:28 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:08:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:08:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updating instance_info_cache with network_info: [{"id": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "address": "fa:16:3e:cc:e8:98", "network": {"id": "d9bd4b73-ff7d-466e-9d5a-92a66713f345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2138648596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d7dcea-66", "ovs_interfaceid": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59952b1f-a979-435c-b62a-121d29086ca8", "address": "fa:16:3e:50:41:f5", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59952b1f-a9", "ovs_interfaceid": "59952b1f-a979-435c-b62a-121d29086ca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "303d5eaf-9f56-46f8-a525-38e786edba0f", "address": "fa:16:3e:60:b3:14", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303d5eaf-9f", "ovs_interfaceid": "303d5eaf-9f56-46f8-a525-38e786edba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eee5f90-639a-4724-9758-0689e4548963", "address": "fa:16:3e:7c:7a:10", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee5f90-63", "ovs_interfaceid": "2eee5f90-639a-4724-9758-0689e4548963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "address": "fa:16:3e:71:74:23", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6dbc98-d0", "ovs_interfaceid": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "address": "fa:16:3e:7c:02:0f", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f11c7c-09", "ovs_interfaceid": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "address": "fa:16:3e:dc:39:ca", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca21dc2-49", "ovs_interfaceid": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:08:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Releasing lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:08:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Instance network_info: |[{"id": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "address": "fa:16:3e:cc:e8:98", "network": {"id": "d9bd4b73-ff7d-466e-9d5a-92a66713f345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2138648596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d7dcea-66", "ovs_interfaceid": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59952b1f-a979-435c-b62a-121d29086ca8", "address": "fa:16:3e:50:41:f5", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59952b1f-a9", "ovs_interfaceid": "59952b1f-a979-435c-b62a-121d29086ca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "303d5eaf-9f56-46f8-a525-38e786edba0f", "address": "fa:16:3e:60:b3:14", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303d5eaf-9f", "ovs_interfaceid": "303d5eaf-9f56-46f8-a525-38e786edba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eee5f90-639a-4724-9758-0689e4548963", "address": "fa:16:3e:7c:7a:10", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee5f90-63", "ovs_interfaceid": "2eee5f90-639a-4724-9758-0689e4548963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "address": "fa:16:3e:71:74:23", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6dbc98-d0", "ovs_interfaceid": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "address": "fa:16:3e:7c:02:0f", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f11c7c-09", "ovs_interfaceid": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "address": "fa:16:3e:dc:39:ca", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca21dc2-49", "ovs_interfaceid": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:08:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-197c0455-0b71-4a33-876a-6d005e652ce3 req-e487cb9c-1694-4877-bc6d-f0b270879e20 service nova] Acquired lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:08:28 user nova-compute[71312]: DEBUG nova.network.neutron [req-197c0455-0b71-4a33-876a-6d005e652ce3 req-e487cb9c-1694-4877-bc6d-f0b270879e20 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing network info cache for port 4ca21dc2-4954-40eb-81b9-de0d4d91c08c {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-197c0455-0b71-4a33-876a-6d005e652ce3 req-e487cb9c-1694-4877-bc6d-f0b270879e20 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updated VIF entry in instance network info cache for port 4ca21dc2-4954-40eb-81b9-de0d4d91c08c. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-197c0455-0b71-4a33-876a-6d005e652ce3 req-e487cb9c-1694-4877-bc6d-f0b270879e20 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updating instance_info_cache with network_info: [{"id": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "address": "fa:16:3e:cc:e8:98", "network": {"id": "d9bd4b73-ff7d-466e-9d5a-92a66713f345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2138648596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d7dcea-66", "ovs_interfaceid": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59952b1f-a979-435c-b62a-121d29086ca8", "address": "fa:16:3e:50:41:f5", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59952b1f-a9", "ovs_interfaceid": "59952b1f-a979-435c-b62a-121d29086ca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "303d5eaf-9f56-46f8-a525-38e786edba0f", "address": "fa:16:3e:60:b3:14", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303d5eaf-9f", "ovs_interfaceid": "303d5eaf-9f56-46f8-a525-38e786edba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eee5f90-639a-4724-9758-0689e4548963", "address": "fa:16:3e:7c:7a:10", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee5f90-63", "ovs_interfaceid": "2eee5f90-639a-4724-9758-0689e4548963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "address": "fa:16:3e:71:74:23", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6dbc98-d0", "ovs_interfaceid": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "address": "fa:16:3e:7c:02:0f", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f11c7c-09", "ovs_interfaceid": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "address": "fa:16:3e:dc:39:ca", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca21dc2-49", "ovs_interfaceid": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-197c0455-0b71-4a33-876a-6d005e652ce3 req-e487cb9c-1694-4877-bc6d-f0b270879e20 service nova] Releasing lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:29 user nova-compute[71312]: INFO nova.compute.manager [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Terminating instance
Jul 25 10:08:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-15f7d4b7-5bc5-4732-a9bb-3f5a958d8c21 req-6b0abd46-6195-4dd7-8e51-892201aa21b4 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received event network-vif-unplugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15f7d4b7-5bc5-4732-a9bb-3f5a958d8c21 req-6b0abd46-6195-4dd7-8e51-892201aa21b4 service nova] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15f7d4b7-5bc5-4732-a9bb-3f5a958d8c21 req-6b0abd46-6195-4dd7-8e51-892201aa21b4 service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15f7d4b7-5bc5-4732-a9bb-3f5a958d8c21 req-6b0abd46-6195-4dd7-8e51-892201aa21b4 service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-15f7d4b7-5bc5-4732-a9bb-3f5a958d8c21 req-6b0abd46-6195-4dd7-8e51-892201aa21b4 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] No waiting events found dispatching network-vif-unplugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-15f7d4b7-5bc5-4732-a9bb-3f5a958d8c21 req-6b0abd46-6195-4dd7-8e51-892201aa21b4 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received event network-vif-unplugged-af6ee907-1823-4491-b764-5f935bcccc39 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:08:29 user nova-compute[71312]: INFO nova.virt.block_device [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Booting with volume 7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 at /dev/vdc
Jul 25 10:08:30 user nova-compute[71312]: DEBUG os_brick.utils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[76193f43-5928-4254-ae08-167a12d5523b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4329284e-2483-415b-98b1-f649fddb408d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[46246ecd-ad02-43d3-a8c6-4b82e60f1393]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fd137c-e9b2-40f2-8c24-8d28119cc93f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:08:30 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df1d7a2-b0c5-4a35-b20c-794d3f4a9972]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG os_brick.utils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updating existing volume attachment record: 68a1ca4a-cfe2-48d5-92c8-79f64d0fbcc5 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Instance destroyed successfully.
Jul 25 10:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lazy-loading 'resources' on Instance uuid 999efbaf-c2e1-40bc-a952-c65d2ce9a47c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2000996223',display_name='tempest-TestVolumeSwap-server-2000996223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2000996223',id=16,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW3ojFt+7tTYOQ1Ozw8yQya8eRLTnbKEfPzpSgDo7sJgdRE0ruvpq5SuAVIdLvwZIprdE9Y5FIRR5D0N9Q5xZw9dmxIOiNvZwfCvkOzJy9bTvIMkCyFMF963qkjuatB9w==',key_name='tempest-keypair-711902363',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:05:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1503c144127642369fc6df38c3da51ca',ramdisk_id='',reservation_id='r-kjy032c8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-990047030',owner_user_name='tempest-TestVolumeSwap-990047030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:05:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d3a0ce6e0f94fdf90ca72f98c55711a',uuid=999efbaf-c2e1-40bc-a952-c65d2ce9a47c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af6ee907-1823-4491-b764-5f935bcccc39", "address": "fa:16:3e:80:bd:76", "network": {"id": "8630c9a5-68e0-4e8f-99c6-3db501a1788f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1102930524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1503c144127642369fc6df38c3da51ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6ee907-18", "ovs_interfaceid": "af6ee907-1823-4491-b764-5f935bcccc39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Converting VIF {"id": "af6ee907-1823-4491-b764-5f935bcccc39", "address": "fa:16:3e:80:bd:76", "network": {"id": "8630c9a5-68e0-4e8f-99c6-3db501a1788f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1102930524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1503c144127642369fc6df38c3da51ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6ee907-18", "ovs_interfaceid": "af6ee907-1823-4491-b764-5f935bcccc39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=af6ee907-1823-4491-b764-5f935bcccc39,network=Network(8630c9a5-68e0-4e8f-99c6-3db501a1788f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf6ee907-18') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG os_vif [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=af6ee907-1823-4491-b764-5f935bcccc39,network=Network(8630c9a5-68e0-4e8f-99c6-3db501a1788f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf6ee907-18') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf6ee907-18, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:08:30 user nova-compute[71312]: INFO os_vif [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:bd:76,bridge_name='br-int',has_traffic_filtering=True,id=af6ee907-1823-4491-b764-5f935bcccc39,network=Network(8630c9a5-68e0-4e8f-99c6-3db501a1788f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf6ee907-18')
Jul 25 10:08:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Deleting instance files /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c_del
Jul 25 10:08:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Deletion of /opt/stack/data/nova/instances/999efbaf-c2e1-40bc-a952-c65d2ce9a47c_del complete
Jul 25 10:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:30 user nova-compute[71312]: INFO nova.compute.manager [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 25 10:08:30 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received event network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] No waiting events found dispatching network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:31 user nova-compute[71312]: WARNING nova.compute.manager [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received unexpected event network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 for instance with vm_state active and task_state deleting.
Jul 25 10:08:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received event network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] No waiting events found dispatching network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:31 user nova-compute[71312]: WARNING nova.compute.manager [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received unexpected event network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 for instance with vm_state active and task_state deleting.
Jul 25 10:08:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received event network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] No waiting events found dispatching network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:31 user nova-compute[71312]: WARNING nova.compute.manager [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received unexpected event network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 for instance with vm_state active and task_state deleting.
Jul 25 10:08:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received event network-vif-unplugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] No waiting events found dispatching network-vif-unplugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-fb1066b2-aeb2-4b6f-8fbc-8b9d687739da req-9c0031a3-99ed-4759-b8be-a238bb979a8a service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received event network-vif-unplugged-af6ee907-1823-4491-b764-5f935bcccc39 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:08:32 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:08:32 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Took 1.74 seconds to deallocate network for instance.
Jul 25 10:08:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:32 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:08:32 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:08:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:32 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Deleted allocations for instance 999efbaf-c2e1-40bc-a952-c65d2ce9a47c
Jul 25 10:08:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6f0abcab-a763-4379-97f8-aad2d5bcccca tempest-TestVolumeSwap-990047030 tempest-TestVolumeSwap-990047030-project-member] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.163s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-6b4a8366-4855-4d3a-9b2f-1e27e9d4ea1d req-f7a3c4bb-b380-4699-b534-9a63f9d39842 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received event network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6b4a8366-4855-4d3a-9b2f-1e27e9d4ea1d req-f7a3c4bb-b380-4699-b534-9a63f9d39842 service nova] Acquiring lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6b4a8366-4855-4d3a-9b2f-1e27e9d4ea1d req-f7a3c4bb-b380-4699-b534-9a63f9d39842 service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6b4a8366-4855-4d3a-9b2f-1e27e9d4ea1d req-f7a3c4bb-b380-4699-b534-9a63f9d39842 service nova] Lock "999efbaf-c2e1-40bc-a952-c65d2ce9a47c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-6b4a8366-4855-4d3a-9b2f-1e27e9d4ea1d req-f7a3c4bb-b380-4699-b534-9a63f9d39842 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] No waiting events found dispatching network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:34 user nova-compute[71312]: WARNING nova.compute.manager [req-6b4a8366-4855-4d3a-9b2f-1e27e9d4ea1d req-f7a3c4bb-b380-4699-b534-9a63f9d39842 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received unexpected event network-vif-plugged-af6ee907-1823-4491-b764-5f935bcccc39 for instance with vm_state deleted and task_state None.
Jul 25 10:08:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-6b4a8366-4855-4d3a-9b2f-1e27e9d4ea1d req-f7a3c4bb-b380-4699-b534-9a63f9d39842 service nova] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Received event network-vif-deleted-af6ee907-1823-4491-b764-5f935bcccc39 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:08:37 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Creating image(s)
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Ensure instance console log exists: /opt/stack/data/nova/instances/3a5a9026-70f9-42fd-b8f8-66fc893ced35/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Start _get_guest_xml network_info=[{"id": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "address": "fa:16:3e:cc:e8:98", "network": {"id": "d9bd4b73-ff7d-466e-9d5a-92a66713f345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2138648596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d7dcea-66", "ovs_interfaceid": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59952b1f-a979-435c-b62a-121d29086ca8", "address": "fa:16:3e:50:41:f5", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59952b1f-a9", "ovs_interfaceid": "59952b1f-a979-435c-b62a-121d29086ca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "303d5eaf-9f56-46f8-a525-38e786edba0f", "address": "fa:16:3e:60:b3:14", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303d5eaf-9f", "ovs_interfaceid": "303d5eaf-9f56-46f8-a525-38e786edba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eee5f90-639a-4724-9758-0689e4548963", "address": "fa:16:3e:7c:7a:10", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee5f90-63", "ovs_interfaceid": "2eee5f90-639a-4724-9758-0689e4548963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "address": "fa:16:3e:71:74:23", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6dbc98-d0", "ovs_interfaceid": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "address": "fa:16:3e:7c:02:0f", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f11c7c-09", "ovs_interfaceid": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "address": "fa:16:3e:dc:39:ca", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca21dc2-49", "ovs_interfaceid": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '74742e7f-36f1-4efe-8b09-221e7ab35a47', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvocUhpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a5a9026-70f9-42fd-b8f8-66fc893ced35', 'attached_at': '', 'detached_at': '', 'volume_id': '307e9899-abfd-4370-a46e-da0f8d160087', 'serial': '307e9899-abfd-4370-a46e-da0f8d160087'}, 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 1, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '4489e57d-936b-4199-bfae-21aae056b01d', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgRaNEOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a5a9026-70f9-42fd-b8f8-66fc893ced35', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2e66dab-75fe-4f24-9045-d554eac9ccd8', 'serial': 'f2e66dab-75fe-4f24-9045-d554eac9ccd8'}, 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 2, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '68a1ca4a-cfe2-48d5-92c8-79f64d0fbcc5', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEkwLWsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a5a9026-70f9-42fd-b8f8-66fc893ced35', 'attached_at': '', 'detached_at': '', 'volume_id': '7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0', 'serial': '7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:08:37 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:08:37 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvocUhpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:08:37 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:08:37 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:08:37 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b4d60d-5c25-456d-a97c-a4a4c81c4d53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:08:37 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e071ea9e-0be9-4b58-b68a-638af4b8698a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087] added
Jul 25 10:08:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[21643d50-fd7f-439f-9043-fd565975533a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9205160-3aa7-4b98-a1b2-d319eee04139]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yvocUhpr {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yvocUhpr" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a0759a-9302-4582-99d8-cd62c4722acf]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yvocUhpr'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b93ce7-e97a-4c00-b986-b5ea089cf85b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7c0eda-0571-45d2-9bdf-9c5130c9342c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:37 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:37 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fbd118-7db9-41dd-89bd-df335c37d625]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087, portal: 172.16.0.220,3260]
Jul 25 10:08:37 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087, portal: 172.16.0.220,3260] successful.
Jul 25 10:08:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5263f59-b71a-4a15-abc9-e94b9db8a0d1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8a273a-b7aa-4851-8627-dfc36ab83301]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:37 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:37 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:08:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:37 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:37 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:08:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2133da-e0ed-4c5a-9cd2-543851e83958]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvocUhpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23735643865383661', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735643865383661', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgRaNEOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:08:38 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:08:38 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:08:38 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d7730c-bcc5-475f-864f-817fe833933c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:08:38 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aa5d61-a2ad-427d-8047-89d528110df0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8] added
Jul 25 10:08:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eead9267-7286-401d-8556-9a5498de0baa]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fc2ef5-b75a-4f85-8f11-bf87fdf5dce5]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fgRaNEOv {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fgRaNEOv" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c0d904-856b-4a5d-88d5-9e1543183396]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fgRaNEOv'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fa4b24-306c-4293-8cc5-5885b42f3011]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb505273-c3a5-48a6-a28f-2c2d335b64d0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:38 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:38 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:08:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:38 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:38 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:08:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f7ba21-c737-42a0-a43f-ef2efada8105]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8, portal: 172.16.0.220,3260]
Jul 25 10:08:38 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8, portal: 172.16.0.220,3260] successful.
Jul 25 10:08:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd71fd3-e646-4d67-9a46-1679b0ca8dd1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2f86be-aa20-45cc-b846-4b10a21ec044]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:38 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:38 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:08:38 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:08:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:38 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:38 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:08:38 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:08:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:08:38 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:08:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:08:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f166bc7-80c6-4c92-b25f-51144cbc0f65]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:08:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgRaNEOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:08:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23939623036383934', 'path': '/dev/sde'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939623036383934', 'path': '/dev/sde'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEkwLWsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:08:40 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:08:40 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:08:40 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7481a0e3-7383-4bff-b1ad-8124d9190b0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:08:40 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47a3da1-6ec8-42f6-a70f-c28a198299e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0] added
Jul 25 10:08:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f819fdb6-8888-481d-b996-eeb65b551f91]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b9d40e-ec51-43dd-83d8-8ec04d7a2bee]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TEkwLWsV {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TEkwLWsV" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f74fb0e-af13-4465-a489-4f2048941f89]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TEkwLWsV'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e7b4b5-83b1-431a-ae0d-7e6d4923ca8f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1534af2e-98e1-4330-b376-d65895dba72b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:40 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:40 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:08:40 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:08:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:40 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:40 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:08:40 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:08:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d336486b-6cad-40b5-8fb8-066b8493237a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0, portal: 172.16.0.220,3260]
Jul 25 10:08:40 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0, portal: 172.16.0.220,3260] successful.
Jul 25 10:08:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[356eff30-df6b-4be2-b1a7-0a2ab36dbb25]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a936c24c-36f8-4866-b9d9-62860f117a80]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:40 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:40 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:08:40 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:08:40 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:08:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:08:40 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:08:40 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:08:40 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:08:40 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:08:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b5f39f-52c7-4bc2-b59e-d4aa7a5760e1]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEkwLWsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:08:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23466626663376631', 'path': '/dev/sdf'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466626663376631', 'path': '/dev/sdf'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "address": "fa:16:3e:cc:e8:98", "network": {"id": "d9bd4b73-ff7d-466e-9d5a-92a66713f345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2138648596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d7dcea-66", "ovs_interfaceid": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "address": "fa:16:3e:cc:e8:98", "network": {"id": "d9bd4b73-ff7d-466e-9d5a-92a66713f345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2138648596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d7dcea-66", "ovs_interfaceid": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e8:98,bridge_name='br-int',has_traffic_filtering=True,id=99d7dcea-66cf-481f-9032-88bc7ca0f945,network=Network(d9bd4b73-ff7d-466e-9d5a-92a66713f345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d7dcea-66') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59952b1f-a979-435c-b62a-121d29086ca8", "address": "fa:16:3e:50:41:f5", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59952b1f-a9", "ovs_interfaceid": "59952b1f-a979-435c-b62a-121d29086ca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "59952b1f-a979-435c-b62a-121d29086ca8", "address": "fa:16:3e:50:41:f5", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59952b1f-a9", "ovs_interfaceid": "59952b1f-a979-435c-b62a-121d29086ca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:41:f5,bridge_name='br-int',has_traffic_filtering=True,id=59952b1f-a979-435c-b62a-121d29086ca8,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap59952b1f-a9') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "303d5eaf-9f56-46f8-a525-38e786edba0f", "address": "fa:16:3e:60:b3:14", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303d5eaf-9f", "ovs_interfaceid": "303d5eaf-9f56-46f8-a525-38e786edba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "303d5eaf-9f56-46f8-a525-38e786edba0f", "address": "fa:16:3e:60:b3:14", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303d5eaf-9f", "ovs_interfaceid": "303d5eaf-9f56-46f8-a525-38e786edba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:b3:14,bridge_name='br-int',has_traffic_filtering=True,id=303d5eaf-9f56-46f8-a525-38e786edba0f,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap303d5eaf-9f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eee5f90-639a-4724-9758-0689e4548963", "address": "fa:16:3e:7c:7a:10", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee5f90-63", "ovs_interfaceid": "2eee5f90-639a-4724-9758-0689e4548963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "2eee5f90-639a-4724-9758-0689e4548963", "address": "fa:16:3e:7c:7a:10", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee5f90-63", "ovs_interfaceid": "2eee5f90-639a-4724-9758-0689e4548963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:7a:10,bridge_name='br-int',has_traffic_filtering=True,id=2eee5f90-639a-4724-9758-0689e4548963,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eee5f90-63') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "address": "fa:16:3e:71:74:23", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6dbc98-d0", "ovs_interfaceid": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "address": "fa:16:3e:71:74:23", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6dbc98-d0", "ovs_interfaceid": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:74:23,bridge_name='br-int',has_traffic_filtering=True,id=7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f6dbc98-d0') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "address": "fa:16:3e:7c:02:0f", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f11c7c-09", "ovs_interfaceid": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "address": "fa:16:3e:7c:02:0f", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f11c7c-09", "ovs_interfaceid": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:02:0f,bridge_name='br-int',has_traffic_filtering=True,id=40f11c7c-09cf-4b21-acb5-a6281b4421ec,network=Network(441fb7a1-13d3-443a-aabc-c441247f856d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f11c7c-09') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "address": "fa:16:3e:dc:39:ca", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca21dc2-49", "ovs_interfaceid": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "address": "fa:16:3e:dc:39:ca", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca21dc2-49", "ovs_interfaceid": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:39:ca,bridge_name='br-int',has_traffic_filtering=True,id=4ca21dc2-4954-40eb-81b9-de0d4d91c08c,network=Network(441fb7a1-13d3-443a-aabc-c441247f856d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca21dc2-49') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a5a9026-70f9-42fd-b8f8-66fc893ced35 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:08:41 user nova-compute[71312]:   <uuid>3a5a9026-70f9-42fd-b8f8-66fc893ced35</uuid>
Jul 25 10:08:41 user nova-compute[71312]:   <name>instance-00000013</name>
Jul 25 10:08:41 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:08:41 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:08:41 user nova-compute[71312]:   <metadata>
Jul 25 10:08:41 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:08:41 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:08:41 user nova-compute[71312]:       <nova:name>tempest-device-tagging-server-1972375399</nova:name>
Jul 25 10:08:41 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:08:37</nova:creationTime>
Jul 25 10:08:41 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:08:41 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:08:41 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:08:41 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:08:41 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:08:41 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:08:41 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:08:41 user nova-compute[71312]:       <nova:owner>
Jul 25 10:08:41 user nova-compute[71312]:         <nova:user uuid="3407a2faec4343109bf84e1e7337af07">tempest-TaggedBootDevicesTest_v242-1961372466-project-member</nova:user>
Jul 25 10:08:41 user nova-compute[71312]:         <nova:project uuid="949c208a6b7c45ff9469fd3b39b560bf">tempest-TaggedBootDevicesTest_v242-1961372466</nova:project>
Jul 25 10:08:41 user nova-compute[71312]:       </nova:owner>
Jul 25 10:08:41 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:08:41 user nova-compute[71312]:       <nova:ports>
Jul 25 10:08:41 user nova-compute[71312]:         <nova:port uuid="99d7dcea-66cf-481f-9032-88bc7ca0f945">
Jul 25 10:08:41 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 10:08:41 user nova-compute[71312]:         </nova:port>
Jul 25 10:08:41 user nova-compute[71312]:         <nova:port uuid="59952b1f-a979-435c-b62a-121d29086ca8">
Jul 25 10:08:41 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.13" ipVersion="4"/>
Jul 25 10:08:41 user nova-compute[71312]:         </nova:port>
Jul 25 10:08:41 user nova-compute[71312]:         <nova:port uuid="303d5eaf-9f56-46f8-a525-38e786edba0f">
Jul 25 10:08:41 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.93" ipVersion="4"/>
Jul 25 10:08:41 user nova-compute[71312]:         </nova:port>
Jul 25 10:08:41 user nova-compute[71312]:         <nova:port uuid="2eee5f90-639a-4724-9758-0689e4548963">
Jul 25 10:08:41 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.229" ipVersion="4"/>
Jul 25 10:08:41 user nova-compute[71312]:         </nova:port>
Jul 25 10:08:41 user nova-compute[71312]:         <nova:port uuid="7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1">
Jul 25 10:08:41 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.243" ipVersion="4"/>
Jul 25 10:08:41 user nova-compute[71312]:         </nova:port>
Jul 25 10:08:41 user nova-compute[71312]:         <nova:port uuid="40f11c7c-09cf-4b21-acb5-a6281b4421ec">
Jul 25 10:08:41 user nova-compute[71312]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 25 10:08:41 user nova-compute[71312]:         </nova:port>
Jul 25 10:08:41 user nova-compute[71312]:         <nova:port uuid="4ca21dc2-4954-40eb-81b9-de0d4d91c08c">
Jul 25 10:08:41 user nova-compute[71312]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 25 10:08:41 user nova-compute[71312]:         </nova:port>
Jul 25 10:08:41 user nova-compute[71312]:       </nova:ports>
Jul 25 10:08:41 user nova-compute[71312]:     </nova:instance>
Jul 25 10:08:41 user nova-compute[71312]:   </metadata>
Jul 25 10:08:41 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:08:41 user nova-compute[71312]:     <system>
Jul 25 10:08:41 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:08:41 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:08:41 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:08:41 user nova-compute[71312]:       <entry name="serial">3a5a9026-70f9-42fd-b8f8-66fc893ced35</entry>
Jul 25 10:08:41 user nova-compute[71312]:       <entry name="uuid">3a5a9026-70f9-42fd-b8f8-66fc893ced35</entry>
Jul 25 10:08:41 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:08:41 user nova-compute[71312]:     </system>
Jul 25 10:08:41 user nova-compute[71312]:   </sysinfo>
Jul 25 10:08:41 user nova-compute[71312]:   <os>
Jul 25 10:08:41 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:08:41 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:08:41 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:08:41 user nova-compute[71312]:   </os>
Jul 25 10:08:41 user nova-compute[71312]:   <features>
Jul 25 10:08:41 user nova-compute[71312]:     <acpi/>
Jul 25 10:08:41 user nova-compute[71312]:     <apic/>
Jul 25 10:08:41 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:08:41 user nova-compute[71312]:   </features>
Jul 25 10:08:41 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:08:41 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:08:41 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:08:41 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:08:41 user nova-compute[71312]:   </clock>
Jul 25 10:08:41 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:08:41 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:08:41 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:08:41 user nova-compute[71312]:   </cpu>
Jul 25 10:08:41 user nova-compute[71312]:   <devices>
Jul 25 10:08:41 user nova-compute[71312]:     <disk type="file" device="cdrom">
Jul 25 10:08:41 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none"/>
Jul 25 10:08:41 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/3a5a9026-70f9-42fd-b8f8-66fc893ced35/disk.config"/>
Jul 25 10:08:41 user nova-compute[71312]:       <target dev="hda" bus="ide"/>
Jul 25 10:08:41 user nova-compute[71312]:     </disk>
Jul 25 10:08:41 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:08:41 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:08:41 user nova-compute[71312]:       <source dev="/dev/sdc"/>
Jul 25 10:08:41 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:08:41 user nova-compute[71312]:       <serial>307e9899-abfd-4370-a46e-da0f8d160087</serial>
Jul 25 10:08:41 user nova-compute[71312]:     </disk>
Jul 25 10:08:41 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:08:41 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:08:41 user nova-compute[71312]:       <source dev="/dev/sde"/>
Jul 25 10:08:41 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Jul 25 10:08:41 user nova-compute[71312]:       <serial>f2e66dab-75fe-4f24-9045-d554eac9ccd8</serial>
Jul 25 10:08:41 user nova-compute[71312]:     </disk>
Jul 25 10:08:41 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:08:41 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:08:41 user nova-compute[71312]:       <source dev="/dev/sdf"/>
Jul 25 10:08:41 user nova-compute[71312]:       <target dev="vdc" bus="virtio"/>
Jul 25 10:08:41 user nova-compute[71312]:       <serial>7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0</serial>
Jul 25 10:08:41 user nova-compute[71312]:     </disk>
Jul 25 10:08:41 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:08:41 user nova-compute[71312]:       <mac address="fa:16:3e:cc:e8:98"/>
Jul 25 10:08:41 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:08:41 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:08:41 user nova-compute[71312]:       <target dev="tap99d7dcea-66"/>
Jul 25 10:08:41 user nova-compute[71312]:     </interface>
Jul 25 10:08:41 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:08:41 user nova-compute[71312]:       <mac address="fa:16:3e:50:41:f5"/>
Jul 25 10:08:41 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:08:41 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:08:41 user nova-compute[71312]:       <target dev="tap59952b1f-a9"/>
Jul 25 10:08:41 user nova-compute[71312]:     </interface>
Jul 25 10:08:41 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:08:41 user nova-compute[71312]:       <mac address="fa:16:3e:60:b3:14"/>
Jul 25 10:08:41 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:08:41 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:08:41 user nova-compute[71312]:       <target dev="tap303d5eaf-9f"/>
Jul 25 10:08:41 user nova-compute[71312]:     </interface>
Jul 25 10:08:41 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:08:41 user nova-compute[71312]:       <mac address="fa:16:3e:7c:7a:10"/>
Jul 25 10:08:41 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:08:41 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:08:41 user nova-compute[71312]:       <target dev="tap2eee5f90-63"/>
Jul 25 10:08:41 user nova-compute[71312]:     </interface>
Jul 25 10:08:41 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:08:41 user nova-compute[71312]:       <mac address="fa:16:3e:71:74:23"/>
Jul 25 10:08:41 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:08:41 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:08:41 user nova-compute[71312]:       <target dev="tap7f6dbc98-d0"/>
Jul 25 10:08:41 user nova-compute[71312]:     </interface>
Jul 25 10:08:41 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:08:41 user nova-compute[71312]:       <mac address="fa:16:3e:7c:02:0f"/>
Jul 25 10:08:41 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:08:41 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:08:41 user nova-compute[71312]:       <target dev="tap40f11c7c-09"/>
Jul 25 10:08:41 user nova-compute[71312]:     </interface>
Jul 25 10:08:41 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:08:41 user nova-compute[71312]:       <mac address="fa:16:3e:dc:39:ca"/>
Jul 25 10:08:41 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:08:41 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:08:41 user nova-compute[71312]:       <target dev="tap4ca21dc2-49"/>
Jul 25 10:08:41 user nova-compute[71312]:     </interface>
Jul 25 10:08:41 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:08:41 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/3a5a9026-70f9-42fd-b8f8-66fc893ced35/console.log" append="off"/>
Jul 25 10:08:41 user nova-compute[71312]:     </serial>
Jul 25 10:08:41 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:08:41 user nova-compute[71312]:     <video>
Jul 25 10:08:41 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:08:41 user nova-compute[71312]:     </video>
Jul 25 10:08:41 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:08:41 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:08:41 user nova-compute[71312]:     </rng>
Jul 25 10:08:41 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:08:41 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:08:41 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:08:41 user nova-compute[71312]:     </memballoon>
Jul 25 10:08:41 user nova-compute[71312]:   </devices>
Jul 25 10:08:41 user nova-compute[71312]: </domain>
Jul 25 10:08:41 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "address": "fa:16:3e:cc:e8:98", "network": {"id": "d9bd4b73-ff7d-466e-9d5a-92a66713f345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2138648596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d7dcea-66", "ovs_interfaceid": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "address": "fa:16:3e:cc:e8:98", "network": {"id": "d9bd4b73-ff7d-466e-9d5a-92a66713f345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2138648596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d7dcea-66", "ovs_interfaceid": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e8:98,bridge_name='br-int',has_traffic_filtering=True,id=99d7dcea-66cf-481f-9032-88bc7ca0f945,network=Network(d9bd4b73-ff7d-466e-9d5a-92a66713f345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d7dcea-66') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG os_vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e8:98,bridge_name='br-int',has_traffic_filtering=True,id=99d7dcea-66cf-481f-9032-88bc7ca0f945,network=Network(d9bd4b73-ff7d-466e-9d5a-92a66713f345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d7dcea-66') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99d7dcea-66, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99d7dcea-66, col_values=(('external_ids', {'iface-id': '99d7dcea-66cf-481f-9032-88bc7ca0f945', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:e8:98', 'vm-uuid': '3a5a9026-70f9-42fd-b8f8-66fc893ced35'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: INFO os_vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e8:98,bridge_name='br-int',has_traffic_filtering=True,id=99d7dcea-66cf-481f-9032-88bc7ca0f945,network=Network(d9bd4b73-ff7d-466e-9d5a-92a66713f345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d7dcea-66')
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59952b1f-a979-435c-b62a-121d29086ca8", "address": "fa:16:3e:50:41:f5", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59952b1f-a9", "ovs_interfaceid": "59952b1f-a979-435c-b62a-121d29086ca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "59952b1f-a979-435c-b62a-121d29086ca8", "address": "fa:16:3e:50:41:f5", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59952b1f-a9", "ovs_interfaceid": "59952b1f-a979-435c-b62a-121d29086ca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:41:f5,bridge_name='br-int',has_traffic_filtering=True,id=59952b1f-a979-435c-b62a-121d29086ca8,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap59952b1f-a9') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG os_vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:41:f5,bridge_name='br-int',has_traffic_filtering=True,id=59952b1f-a979-435c-b62a-121d29086ca8,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap59952b1f-a9') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59952b1f-a9, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59952b1f-a9, col_values=(('external_ids', {'iface-id': '59952b1f-a979-435c-b62a-121d29086ca8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:41:f5', 'vm-uuid': '3a5a9026-70f9-42fd-b8f8-66fc893ced35'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: INFO os_vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:41:f5,bridge_name='br-int',has_traffic_filtering=True,id=59952b1f-a979-435c-b62a-121d29086ca8,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap59952b1f-a9')
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "303d5eaf-9f56-46f8-a525-38e786edba0f", "address": "fa:16:3e:60:b3:14", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303d5eaf-9f", "ovs_interfaceid": "303d5eaf-9f56-46f8-a525-38e786edba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "303d5eaf-9f56-46f8-a525-38e786edba0f", "address": "fa:16:3e:60:b3:14", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303d5eaf-9f", "ovs_interfaceid": "303d5eaf-9f56-46f8-a525-38e786edba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:b3:14,bridge_name='br-int',has_traffic_filtering=True,id=303d5eaf-9f56-46f8-a525-38e786edba0f,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap303d5eaf-9f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG os_vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:b3:14,bridge_name='br-int',has_traffic_filtering=True,id=303d5eaf-9f56-46f8-a525-38e786edba0f,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap303d5eaf-9f') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap303d5eaf-9f, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap303d5eaf-9f, col_values=(('external_ids', {'iface-id': '303d5eaf-9f56-46f8-a525-38e786edba0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:b3:14', 'vm-uuid': '3a5a9026-70f9-42fd-b8f8-66fc893ced35'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: INFO os_vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:b3:14,bridge_name='br-int',has_traffic_filtering=True,id=303d5eaf-9f56-46f8-a525-38e786edba0f,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap303d5eaf-9f')
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eee5f90-639a-4724-9758-0689e4548963", "address": "fa:16:3e:7c:7a:10", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee5f90-63", "ovs_interfaceid": "2eee5f90-639a-4724-9758-0689e4548963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "2eee5f90-639a-4724-9758-0689e4548963", "address": "fa:16:3e:7c:7a:10", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee5f90-63", "ovs_interfaceid": "2eee5f90-639a-4724-9758-0689e4548963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:7a:10,bridge_name='br-int',has_traffic_filtering=True,id=2eee5f90-639a-4724-9758-0689e4548963,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eee5f90-63') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG os_vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:7a:10,bridge_name='br-int',has_traffic_filtering=True,id=2eee5f90-639a-4724-9758-0689e4548963,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eee5f90-63') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eee5f90-63, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eee5f90-63, col_values=(('external_ids', {'iface-id': '2eee5f90-639a-4724-9758-0689e4548963', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:7a:10', 'vm-uuid': '3a5a9026-70f9-42fd-b8f8-66fc893ced35'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: INFO os_vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:7a:10,bridge_name='br-int',has_traffic_filtering=True,id=2eee5f90-639a-4724-9758-0689e4548963,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eee5f90-63')
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "address": "fa:16:3e:71:74:23", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6dbc98-d0", "ovs_interfaceid": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "address": "fa:16:3e:71:74:23", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6dbc98-d0", "ovs_interfaceid": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:74:23,bridge_name='br-int',has_traffic_filtering=True,id=7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f6dbc98-d0') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG os_vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:74:23,bridge_name='br-int',has_traffic_filtering=True,id=7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f6dbc98-d0') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f6dbc98-d0, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f6dbc98-d0, col_values=(('external_ids', {'iface-id': '7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:74:23', 'vm-uuid': '3a5a9026-70f9-42fd-b8f8-66fc893ced35'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: INFO os_vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:74:23,bridge_name='br-int',has_traffic_filtering=True,id=7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f6dbc98-d0')
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "address": "fa:16:3e:7c:02:0f", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f11c7c-09", "ovs_interfaceid": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "address": "fa:16:3e:7c:02:0f", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f11c7c-09", "ovs_interfaceid": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:02:0f,bridge_name='br-int',has_traffic_filtering=True,id=40f11c7c-09cf-4b21-acb5-a6281b4421ec,network=Network(441fb7a1-13d3-443a-aabc-c441247f856d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f11c7c-09') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG os_vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:02:0f,bridge_name='br-int',has_traffic_filtering=True,id=40f11c7c-09cf-4b21-acb5-a6281b4421ec,network=Network(441fb7a1-13d3-443a-aabc-c441247f856d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f11c7c-09') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40f11c7c-09, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40f11c7c-09, col_values=(('external_ids', {'iface-id': '40f11c7c-09cf-4b21-acb5-a6281b4421ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:02:0f', 'vm-uuid': '3a5a9026-70f9-42fd-b8f8-66fc893ced35'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: INFO os_vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:02:0f,bridge_name='br-int',has_traffic_filtering=True,id=40f11c7c-09cf-4b21-acb5-a6281b4421ec,network=Network(441fb7a1-13d3-443a-aabc-c441247f856d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f11c7c-09')
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "address": "fa:16:3e:dc:39:ca", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca21dc2-49", "ovs_interfaceid": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "address": "fa:16:3e:dc:39:ca", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca21dc2-49", "ovs_interfaceid": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:39:ca,bridge_name='br-int',has_traffic_filtering=True,id=4ca21dc2-4954-40eb-81b9-de0d4d91c08c,network=Network(441fb7a1-13d3-443a-aabc-c441247f856d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca21dc2-49') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG os_vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:39:ca,bridge_name='br-int',has_traffic_filtering=True,id=4ca21dc2-4954-40eb-81b9-de0d4d91c08c,network=Network(441fb7a1-13d3-443a-aabc-c441247f856d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca21dc2-49') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ca21dc2-49, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ca21dc2-49, col_values=(('external_ids', {'iface-id': '4ca21dc2-4954-40eb-81b9-de0d4d91c08c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:39:ca', 'vm-uuid': '3a5a9026-70f9-42fd-b8f8-66fc893ced35'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:41 user nova-compute[71312]: INFO os_vif [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:39:ca,bridge_name='br-int',has_traffic_filtering=True,id=4ca21dc2-4954-40eb-81b9-de0d4d91c08c,network=Network(441fb7a1-13d3-443a-aabc-c441247f856d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca21dc2-49')
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] No BDM found with device name hda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] No VIF found with MAC fa:16:3e:cc:e8:98, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:08:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] No VIF found with MAC fa:16:3e:71:74:23, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:08:41 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Using config drive
Jul 25 10:08:42 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Creating config drive at /opt/stack/data/nova/instances/3a5a9026-70f9-42fd-b8f8-66fc893ced35/disk.config
Jul 25 10:08:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a5a9026-70f9-42fd-b8f8-66fc893ced35/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxk_4vglh {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:08:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a5a9026-70f9-42fd-b8f8-66fc893ced35/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxk_4vglh" returned: 0 in 0.066s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:08:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-5b887073-85ce-4dd1-8ebf-71a3b504e96b req-818d305e-3a5d-44c9-9095-a5cc75bc596b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5b887073-85ce-4dd1-8ebf-71a3b504e96b req-818d305e-3a5d-44c9-9095-a5cc75bc596b service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5b887073-85ce-4dd1-8ebf-71a3b504e96b req-818d305e-3a5d-44c9-9095-a5cc75bc596b service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5b887073-85ce-4dd1-8ebf-71a3b504e96b req-818d305e-3a5d-44c9-9095-a5cc75bc596b service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-5b887073-85ce-4dd1-8ebf-71a3b504e96b req-818d305e-3a5d-44c9-9095-a5cc75bc596b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:43 user nova-compute[71312]: WARNING nova.compute.manager [req-5b887073-85ce-4dd1-8ebf-71a3b504e96b req-818d305e-3a5d-44c9-9095-a5cc75bc596b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-99d7dcea-66cf-481f-9032-88bc7ca0f945 for instance with vm_state building and task_state spawning.
Jul 25 10:08:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-4737725a-85dc-4c6e-b0bb-80a6affac8dd req-c190b187-ad69-4afd-b005-c2147c80d56f service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-59952b1f-a979-435c-b62a-121d29086ca8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4737725a-85dc-4c6e-b0bb-80a6affac8dd req-c190b187-ad69-4afd-b005-c2147c80d56f service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4737725a-85dc-4c6e-b0bb-80a6affac8dd req-c190b187-ad69-4afd-b005-c2147c80d56f service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4737725a-85dc-4c6e-b0bb-80a6affac8dd req-c190b187-ad69-4afd-b005-c2147c80d56f service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-4737725a-85dc-4c6e-b0bb-80a6affac8dd req-c190b187-ad69-4afd-b005-c2147c80d56f service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-59952b1f-a979-435c-b62a-121d29086ca8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:44 user nova-compute[71312]: WARNING nova.compute.manager [req-4737725a-85dc-4c6e-b0bb-80a6affac8dd req-c190b187-ad69-4afd-b005-c2147c80d56f service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-59952b1f-a979-435c-b62a-121d29086ca8 for instance with vm_state building and task_state spawning.
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279710.366515, 999efbaf-c2e1-40bc-a952-c65d2ce9a47c => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:08:45 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] VM Stopped (Lifecycle Event)
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-a58de9bd-0f06-4775-b573-f191720ff872 req-48942296-2170-454c-bcbb-e757356ff134 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-40f11c7c-09cf-4b21-acb5-a6281b4421ec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a58de9bd-0f06-4775-b573-f191720ff872 req-48942296-2170-454c-bcbb-e757356ff134 service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a58de9bd-0f06-4775-b573-f191720ff872 req-48942296-2170-454c-bcbb-e757356ff134 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a58de9bd-0f06-4775-b573-f191720ff872 req-48942296-2170-454c-bcbb-e757356ff134 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-a58de9bd-0f06-4775-b573-f191720ff872 req-48942296-2170-454c-bcbb-e757356ff134 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-40f11c7c-09cf-4b21-acb5-a6281b4421ec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:45 user nova-compute[71312]: WARNING nova.compute.manager [req-a58de9bd-0f06-4775-b573-f191720ff872 req-48942296-2170-454c-bcbb-e757356ff134 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-40f11c7c-09cf-4b21-acb5-a6281b4421ec for instance with vm_state building and task_state spawning.
Jul 25 10:08:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-de0e6033-b775-4dcd-a94b-49fb74d8d3cc None None] [instance: 999efbaf-c2e1-40bc-a952-c65d2ce9a47c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:45 user nova-compute[71312]: WARNING nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-99d7dcea-66cf-481f-9032-88bc7ca0f945 for instance with vm_state building and task_state spawning.
Jul 25 10:08:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-303d5eaf-9f56-46f8-a525-38e786edba0f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-303d5eaf-9f56-46f8-a525-38e786edba0f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:45 user nova-compute[71312]: WARNING nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-303d5eaf-9f56-46f8-a525-38e786edba0f for instance with vm_state building and task_state spawning.
Jul 25 10:08:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-303d5eaf-9f56-46f8-a525-38e786edba0f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-303d5eaf-9f56-46f8-a525-38e786edba0f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:45 user nova-compute[71312]: WARNING nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-303d5eaf-9f56-46f8-a525-38e786edba0f for instance with vm_state building and task_state spawning.
Jul 25 10:08:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:45 user nova-compute[71312]: WARNING nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 for instance with vm_state building and task_state spawning.
Jul 25 10:08:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:45 user nova-compute[71312]: WARNING nova.compute.manager [req-253ed5b2-dedb-4f15-9a37-a2844d812c1b req-ed094335-5760-49af-b7cc-79ae5d60446d service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 for instance with vm_state building and task_state spawning.
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-59952b1f-a979-435c-b62a-121d29086ca8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-59952b1f-a979-435c-b62a-121d29086ca8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:46 user nova-compute[71312]: WARNING nova.compute.manager [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-59952b1f-a979-435c-b62a-121d29086ca8 for instance with vm_state building and task_state spawning.
Jul 25 10:08:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-2eee5f90-639a-4724-9758-0689e4548963 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-2eee5f90-639a-4724-9758-0689e4548963 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:46 user nova-compute[71312]: WARNING nova.compute.manager [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-2eee5f90-639a-4724-9758-0689e4548963 for instance with vm_state building and task_state spawning.
Jul 25 10:08:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-2eee5f90-639a-4724-9758-0689e4548963 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-2eee5f90-639a-4724-9758-0689e4548963 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:46 user nova-compute[71312]: WARNING nova.compute.manager [req-d75e5757-61dd-4e7f-b9e5-77c379d34252 req-6142266c-70d7-4d0a-84bd-0f766e85421b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-2eee5f90-639a-4724-9758-0689e4548963 for instance with vm_state building and task_state spawning.
Jul 25 10:08:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-40f11c7c-09cf-4b21-acb5-a6281b4421ec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-40f11c7c-09cf-4b21-acb5-a6281b4421ec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:47 user nova-compute[71312]: WARNING nova.compute.manager [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-40f11c7c-09cf-4b21-acb5-a6281b4421ec for instance with vm_state building and task_state spawning.
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-4ca21dc2-4954-40eb-81b9-de0d4d91c08c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-4ca21dc2-4954-40eb-81b9-de0d4d91c08c {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:47 user nova-compute[71312]: WARNING nova.compute.manager [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-4ca21dc2-4954-40eb-81b9-de0d4d91c08c for instance with vm_state building and task_state spawning.
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-4ca21dc2-4954-40eb-81b9-de0d4d91c08c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-4ca21dc2-4954-40eb-81b9-de0d4d91c08c {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:08:47 user nova-compute[71312]: WARNING nova.compute.manager [req-e64fe3c5-2f67-488c-b888-001ec6d9190e req-d29aa7ba-408f-4015-8329-042952523336 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-4ca21dc2-4954-40eb-81b9-de0d4d91c08c for instance with vm_state building and task_state spawning.
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279727.524395, 3a5a9026-70f9-42fd-b8f8-66fc893ced35 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:08:47 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] VM Resumed (Lifecycle Event)
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:08:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Instance spawned successfully.
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:08:47 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279727.526251, 3a5a9026-70f9-42fd-b8f8-66fc893ced35 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:08:47 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] VM Started (Lifecycle Event)
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:08:47 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:08:47 user nova-compute[71312]: INFO nova.compute.manager [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Took 10.36 seconds to spawn the instance on the hypervisor.
Jul 25 10:08:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:08:47 user nova-compute[71312]: INFO nova.compute.manager [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Took 33.27 seconds to build instance.
Jul 25 10:08:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c22f32e8-30fd-40ad-b959-a89fa5a15b1d tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.382s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:08:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:08:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:03 user nova-compute[71312]: INFO nova.compute.manager [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Unshelving
Jul 25 10:09:03 user nova-compute[71312]: INFO nova.virt.block_device [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Booting with volume 50dff2d6-78b1-43e1-a3ab-f729dae8730f at /dev/vdc
Jul 25 10:09:03 user nova-compute[71312]: DEBUG os_brick.utils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c8c081-75db-49d6-8268-6a0b2590057f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[640d0a87-bcaf-43a1-8e9e-d586d98d5640]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fdb7b5-831e-4f19-a526-064c459ecf40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb20bbd-f7b0-4336-a2c2-2f9f91f2b1aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:09:03 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:09:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4df83de-f8b5-4425-84da-d43b4bce3dab]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG os_brick.utils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:09:03 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Updating existing volume attachment record: 8adaebd2-4d4a-45a3-a1ff-b0934d3bb91e {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:09:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "2e01c123-09c0-4a29-abf0-727f61484747" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "2e01c123-09c0-4a29-abf0-727f61484747" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:09:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:05 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:09:05 user nova-compute[71312]: INFO nova.compute.claims [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Claim successful on node user
Jul 25 10:09:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:09:05 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:09:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:09:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:09:05 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:09:05 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:09:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:09:05 user nova-compute[71312]: DEBUG nova.policy [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96d25383d4b6448da2d30479a26bfa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14fcd7739f41eabc9e7120f5b58a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:09:06 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Creating image(s)
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "/opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "/opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.129s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk 1073741824" returned: 0 in 0.060s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Successfully created port: 22e0953e-fabd-4f5c-9ec7-157b5851e87d {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Cannot resize image /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'migration_context' on Instance uuid 2e01c123-09c0-4a29-abf0-727f61484747 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Ensure instance console log exists: /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Successfully updated port: 22e0953e-fabd-4f5c-9ec7-157b5851e87d {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "refresh_cache-2e01c123-09c0-4a29-abf0-727f61484747" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquired lock "refresh_cache-2e01c123-09c0-4a29-abf0-727f61484747" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-11d87c17-dd5c-4911-89ea-788962a139ef req-baa67dc8-39af-495b-8881-37b9058f4a4e service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Received event network-changed-22e0953e-fabd-4f5c-9ec7-157b5851e87d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-11d87c17-dd5c-4911-89ea-788962a139ef req-baa67dc8-39af-495b-8881-37b9058f4a4e service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Refreshing instance network info cache due to event network-changed-22e0953e-fabd-4f5c-9ec7-157b5851e87d. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-11d87c17-dd5c-4911-89ea-788962a139ef req-baa67dc8-39af-495b-8881-37b9058f4a4e service nova] Acquiring lock "refresh_cache-2e01c123-09c0-4a29-abf0-727f61484747" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Updating instance_info_cache with network_info: [{"id": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "address": "fa:16:3e:b4:f1:6b", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22e0953e-fa", "ovs_interfaceid": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Releasing lock "refresh_cache-2e01c123-09c0-4a29-abf0-727f61484747" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Instance network_info: |[{"id": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "address": "fa:16:3e:b4:f1:6b", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22e0953e-fa", "ovs_interfaceid": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-11d87c17-dd5c-4911-89ea-788962a139ef req-baa67dc8-39af-495b-8881-37b9058f4a4e service nova] Acquired lock "refresh_cache-2e01c123-09c0-4a29-abf0-727f61484747" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-11d87c17-dd5c-4911-89ea-788962a139ef req-baa67dc8-39af-495b-8881-37b9058f4a4e service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Refreshing network info cache for port 22e0953e-fabd-4f5c-9ec7-157b5851e87d {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Start _get_guest_xml network_info=[{"id": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "address": "fa:16:3e:b4:f1:6b", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22e0953e-fa", "ovs_interfaceid": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:09:07 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:09:07 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-415776193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-415776193',id=20,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b14fcd7739f41eabc9e7120f5b58a08',ramdisk_id='',reservation_id='r-zy3urfqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-13369838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:09:06Z,user_data=None,user_id='96d25383d4b6448da2d30479a26bfa0f',uuid=2e01c123-09c0-4a29-abf0-727f61484747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "address": "fa:16:3e:b4:f1:6b", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22e0953e-fa", "ovs_interfaceid": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converting VIF {"id": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "address": "fa:16:3e:b4:f1:6b", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22e0953e-fa", "ovs_interfaceid": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f1:6b,bridge_name='br-int',has_traffic_filtering=True,id=22e0953e-fabd-4f5c-9ec7-157b5851e87d,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22e0953e-fa') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e01c123-09c0-4a29-abf0-727f61484747 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:09:07 user nova-compute[71312]:   <uuid>2e01c123-09c0-4a29-abf0-727f61484747</uuid>
Jul 25 10:09:07 user nova-compute[71312]:   <name>instance-00000014</name>
Jul 25 10:09:07 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:09:07 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:09:07 user nova-compute[71312]:   <metadata>
Jul 25 10:09:07 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:09:07 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:09:07 user nova-compute[71312]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-415776193</nova:name>
Jul 25 10:09:07 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:09:07</nova:creationTime>
Jul 25 10:09:07 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:09:07 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:09:07 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:09:07 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:09:07 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:09:07 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:09:07 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:09:07 user nova-compute[71312]:       <nova:owner>
Jul 25 10:09:07 user nova-compute[71312]:         <nova:user uuid="96d25383d4b6448da2d30479a26bfa0f">tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member</nova:user>
Jul 25 10:09:07 user nova-compute[71312]:         <nova:project uuid="0b14fcd7739f41eabc9e7120f5b58a08">tempest-ServerBootFromVolumeStableRescueTest-13369838</nova:project>
Jul 25 10:09:07 user nova-compute[71312]:       </nova:owner>
Jul 25 10:09:07 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:09:07 user nova-compute[71312]:       <nova:ports>
Jul 25 10:09:07 user nova-compute[71312]:         <nova:port uuid="22e0953e-fabd-4f5c-9ec7-157b5851e87d">
Jul 25 10:09:07 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 10:09:07 user nova-compute[71312]:         </nova:port>
Jul 25 10:09:07 user nova-compute[71312]:       </nova:ports>
Jul 25 10:09:07 user nova-compute[71312]:     </nova:instance>
Jul 25 10:09:07 user nova-compute[71312]:   </metadata>
Jul 25 10:09:07 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:09:07 user nova-compute[71312]:     <system>
Jul 25 10:09:07 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:09:07 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:09:07 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:09:07 user nova-compute[71312]:       <entry name="serial">2e01c123-09c0-4a29-abf0-727f61484747</entry>
Jul 25 10:09:07 user nova-compute[71312]:       <entry name="uuid">2e01c123-09c0-4a29-abf0-727f61484747</entry>
Jul 25 10:09:07 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:09:07 user nova-compute[71312]:     </system>
Jul 25 10:09:07 user nova-compute[71312]:   </sysinfo>
Jul 25 10:09:07 user nova-compute[71312]:   <os>
Jul 25 10:09:07 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:09:07 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:09:07 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:09:07 user nova-compute[71312]:   </os>
Jul 25 10:09:07 user nova-compute[71312]:   <features>
Jul 25 10:09:07 user nova-compute[71312]:     <acpi/>
Jul 25 10:09:07 user nova-compute[71312]:     <apic/>
Jul 25 10:09:07 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:09:07 user nova-compute[71312]:   </features>
Jul 25 10:09:07 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:09:07 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:09:07 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:09:07 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:09:07 user nova-compute[71312]:   </clock>
Jul 25 10:09:07 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:09:07 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:09:07 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:09:07 user nova-compute[71312]:   </cpu>
Jul 25 10:09:07 user nova-compute[71312]:   <devices>
Jul 25 10:09:07 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:09:07 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:09:07 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk"/>
Jul 25 10:09:07 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:09:07 user nova-compute[71312]:     </disk>
Jul 25 10:09:07 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:09:07 user nova-compute[71312]:       <mac address="fa:16:3e:b4:f1:6b"/>
Jul 25 10:09:07 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:09:07 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:09:07 user nova-compute[71312]:       <target dev="tap22e0953e-fa"/>
Jul 25 10:09:07 user nova-compute[71312]:     </interface>
Jul 25 10:09:07 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:09:07 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/console.log" append="off"/>
Jul 25 10:09:07 user nova-compute[71312]:     </serial>
Jul 25 10:09:07 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:09:07 user nova-compute[71312]:     <video>
Jul 25 10:09:07 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:09:07 user nova-compute[71312]:     </video>
Jul 25 10:09:07 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:09:07 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:09:07 user nova-compute[71312]:     </rng>
Jul 25 10:09:07 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:09:07 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:09:07 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:09:07 user nova-compute[71312]:     </memballoon>
Jul 25 10:09:07 user nova-compute[71312]:   </devices>
Jul 25 10:09:07 user nova-compute[71312]: </domain>
Jul 25 10:09:07 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-415776193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-415776193',id=20,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b14fcd7739f41eabc9e7120f5b58a08',ramdisk_id='',reservation_id='r-zy3urfqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-13369838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:09:06Z,user_data=None,user_id='96d25383d4b6448da2d30479a26bfa0f',uuid=2e01c123-09c0-4a29-abf0-727f61484747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "address": "fa:16:3e:b4:f1:6b", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22e0953e-fa", "ovs_interfaceid": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converting VIF {"id": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "address": "fa:16:3e:b4:f1:6b", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22e0953e-fa", "ovs_interfaceid": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f1:6b,bridge_name='br-int',has_traffic_filtering=True,id=22e0953e-fabd-4f5c-9ec7-157b5851e87d,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22e0953e-fa') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG os_vif [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f1:6b,bridge_name='br-int',has_traffic_filtering=True,id=22e0953e-fabd-4f5c-9ec7-157b5851e87d,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22e0953e-fa') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22e0953e-fa, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22e0953e-fa, col_values=(('external_ids', {'iface-id': '22e0953e-fabd-4f5c-9ec7-157b5851e87d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:f1:6b', 'vm-uuid': '2e01c123-09c0-4a29-abf0-727f61484747'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:09:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:07 user nova-compute[71312]: INFO os_vif [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f1:6b,bridge_name='br-int',has_traffic_filtering=True,id=22e0953e-fabd-4f5c-9ec7-157b5851e87d,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22e0953e-fa')
Jul 25 10:09:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:09:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] No VIF found with MAC fa:16:3e:b4:f1:6b, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:09:08 user nova-compute[71312]: DEBUG nova.network.neutron [req-11d87c17-dd5c-4911-89ea-788962a139ef req-baa67dc8-39af-495b-8881-37b9058f4a4e service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Updated VIF entry in instance network info cache for port 22e0953e-fabd-4f5c-9ec7-157b5851e87d. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:09:08 user nova-compute[71312]: DEBUG nova.network.neutron [req-11d87c17-dd5c-4911-89ea-788962a139ef req-baa67dc8-39af-495b-8881-37b9058f4a4e service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Updating instance_info_cache with network_info: [{"id": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "address": "fa:16:3e:b4:f1:6b", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22e0953e-fa", "ovs_interfaceid": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:09:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-11d87c17-dd5c-4911-89ea-788962a139ef req-baa67dc8-39af-495b-8881-37b9058f4a4e service nova] Releasing lock "refresh_cache-2e01c123-09c0-4a29-abf0-727f61484747" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:09:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-fc98122f-b071-41c0-a49a-d12860c5e1de req-a8db4f1b-546c-4558-9a27-6d07f2e8cbc4 service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Received event network-vif-plugged-22e0953e-fabd-4f5c-9ec7-157b5851e87d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fc98122f-b071-41c0-a49a-d12860c5e1de req-a8db4f1b-546c-4558-9a27-6d07f2e8cbc4 service nova] Acquiring lock "2e01c123-09c0-4a29-abf0-727f61484747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fc98122f-b071-41c0-a49a-d12860c5e1de req-a8db4f1b-546c-4558-9a27-6d07f2e8cbc4 service nova] Lock "2e01c123-09c0-4a29-abf0-727f61484747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fc98122f-b071-41c0-a49a-d12860c5e1de req-a8db4f1b-546c-4558-9a27-6d07f2e8cbc4 service nova] Lock "2e01c123-09c0-4a29-abf0-727f61484747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-fc98122f-b071-41c0-a49a-d12860c5e1de req-a8db4f1b-546c-4558-9a27-6d07f2e8cbc4 service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] No waiting events found dispatching network-vif-plugged-22e0953e-fabd-4f5c-9ec7-157b5851e87d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:09:09 user nova-compute[71312]: WARNING nova.compute.manager [req-fc98122f-b071-41c0-a49a-d12860c5e1de req-a8db4f1b-546c-4558-9a27-6d07f2e8cbc4 service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Received unexpected event network-vif-plugged-22e0953e-fabd-4f5c-9ec7-157b5851e87d for instance with vm_state building and task_state spawning.
Jul 25 10:09:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:10 user nova-compute[71312]: INFO nova.compute.manager [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Terminating instance
Jul 25 10:09:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:09:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-fc1d323f-785b-4182-aa11-4fe1f3fd1bed req-2540bbf6-a00f-4dfa-9d39-4037e04b3385 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-vif-unplugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fc1d323f-785b-4182-aa11-4fe1f3fd1bed req-2540bbf6-a00f-4dfa-9d39-4037e04b3385 service nova] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fc1d323f-785b-4182-aa11-4fe1f3fd1bed req-2540bbf6-a00f-4dfa-9d39-4037e04b3385 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fc1d323f-785b-4182-aa11-4fe1f3fd1bed req-2540bbf6-a00f-4dfa-9d39-4037e04b3385 service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-fc1d323f-785b-4182-aa11-4fe1f3fd1bed req-2540bbf6-a00f-4dfa-9d39-4037e04b3385 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] No waiting events found dispatching network-vif-unplugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:09:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-fc1d323f-785b-4182-aa11-4fe1f3fd1bed req-2540bbf6-a00f-4dfa-9d39-4037e04b3385 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-vif-unplugged-8727a126-c33f-4868-8651-45e7c1f663d2 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:09:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Instance destroyed successfully.
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lazy-loading 'resources' on Instance uuid 9fb85501-6210-4bfd-b496-1891c79fd23c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704266463',display_name='tempest-ServerActionsTestOtherB-server-704266463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704266463',id=4,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeo1OyzMR1FuY3t9bxVf78EYsomUcs1GBJeQZ+xHk7Q6n7Ea0otdZoq9Stbi9efTSjxNpLsJBFIquobgg119YA0SZsVMkFCxXfGhMNAahmBkXlggOo2Y7cPMghqdLy6UQ==',key_name='tempest-keypair-1722521166',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:06:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39ace30139b94322bdc7a657d3546757',ramdisk_id='',reservation_id='r-x9ogqxil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-766110382',owner_user_name='tempest-ServerActionsTestOtherB-766110382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:06:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5186cf6b19094cb2948a2d4f966f3dcc',uuid=9fb85501-6210-4bfd-b496-1891c79fd23c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converting VIF {"id": "8727a126-c33f-4868-8651-45e7c1f663d2", "address": "fa:16:3e:60:72:df", "network": {"id": "496f9362-e299-4a37-b3d4-6cdc029a287c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1712941866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ace30139b94322bdc7a657d3546757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8727a126-c3", "ovs_interfaceid": "8727a126-c33f-4868-8651-45e7c1f663d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_vif [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8727a126-c3, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:09:11 user nova-compute[71312]: INFO os_vif [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:72:df,bridge_name='br-int',has_traffic_filtering=True,id=8727a126-c33f-4868-8651-45e7c1f663d2,network=Network(496f9362-e299-4a37-b3d4-6cdc029a287c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8727a126-c3')
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgKmjAwp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:09:11 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0a5197-b46d-4329-81ed-4e3e201de2ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:09:11 user nova-compute[71312]: No targets found.
Jul 25 10:09:11 user nova-compute[71312]: iSNS:
Jul 25 10:09:11 user nova-compute[71312]: No targets found.
Jul 25 10:09:11 user nova-compute[71312]: STATIC:
Jul 25 10:09:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac
Jul 25 10:09:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0
Jul 25 10:09:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:09:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087
Jul 25 10:09:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8
Jul 25 10:09:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:11 user nova-compute[71312]: FIRMWARE:
Jul 25 10:09:11 user nova-compute[71312]: No targets found.
Jul 25 10:09:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:09:11 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:09:11 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f534d7-5a90-44ea-8ec9-72e3d72ec129]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8896d4-4db8-416a-b749-fa2cda259ce5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:11 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:09:11 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:11 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:11 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:11 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac (non-flash)
Jul 25 10:09:11 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:11 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:11 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a864c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55c9300-d9cd-4a26-a17e-295ff5fb9d7b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'pci_requests' on Instance uuid 9be175c2-20a4-45ce-85a7-ee3c406a4b1f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'numa_topology' on Instance uuid 9be175c2-20a4-45ce-85a7-ee3c406a4b1f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9bdb9f-7759-4cb5-892d-e5dabe4dc0ef]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:09:11 user nova-compute[71312]: INFO nova.compute.claims [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Claim successful on node user
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e3704d-f4bb-4c06-ba29-6f5bd70e8160]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8cb330-042c-44f2-b474-a3debd826aa6]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc5b0c2-d10b-4338-963b-68117bb5f1a8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[68064b65-eb2a-4c20-9a01-0e90cc3a7039]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260]
Jul 25 10:09:11 user nova-compute[71312]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac, portal: 172.16.0.220,3260] successful.
Jul 25 10:09:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3bd4850-4e1c-4068-b953-75f6c4c360ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad3a992-7690-43f3-aa9a-71220095d3bd]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] <== disconnect_volume: return (372ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:09:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Deleting instance files /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c_del
Jul 25 10:09:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Deletion of /opt/stack/data/nova/instances/9fb85501-6210-4bfd-b496-1891c79fd23c_del complete
Jul 25 10:09:11 user nova-compute[71312]: INFO nova.compute.manager [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Took 1.32 seconds to destroy the instance on the hypervisor.
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-08bcf9eb-9a1c-40a4-bc15-5e62274b0d1d req-01acb46c-3484-41d9-929e-1588148f054e service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Received event network-vif-plugged-22e0953e-fabd-4f5c-9ec7-157b5851e87d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-08bcf9eb-9a1c-40a4-bc15-5e62274b0d1d req-01acb46c-3484-41d9-929e-1588148f054e service nova] Acquiring lock "2e01c123-09c0-4a29-abf0-727f61484747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-08bcf9eb-9a1c-40a4-bc15-5e62274b0d1d req-01acb46c-3484-41d9-929e-1588148f054e service nova] Lock "2e01c123-09c0-4a29-abf0-727f61484747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-08bcf9eb-9a1c-40a4-bc15-5e62274b0d1d req-01acb46c-3484-41d9-929e-1588148f054e service nova] Lock "2e01c123-09c0-4a29-abf0-727f61484747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-08bcf9eb-9a1c-40a4-bc15-5e62274b0d1d req-01acb46c-3484-41d9-929e-1588148f054e service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] No waiting events found dispatching network-vif-plugged-22e0953e-fabd-4f5c-9ec7-157b5851e87d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:09:11 user nova-compute[71312]: WARNING nova.compute.manager [req-08bcf9eb-9a1c-40a4-bc15-5e62274b0d1d req-01acb46c-3484-41d9-929e-1588148f054e service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Received unexpected event network-vif-plugged-22e0953e-fabd-4f5c-9ec7-157b5851e87d for instance with vm_state building and task_state spawning.
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279751.77079, 2e01c123-09c0-4a29-abf0-727f61484747 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:09:11 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] VM Resumed (Lifecycle Event)
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:09:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Instance spawned successfully.
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:11 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279751.7709277, 2e01c123-09c0-4a29-abf0-727f61484747 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:09:11 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] VM Started (Lifecycle Event)
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:09:11 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:09:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:11 user nova-compute[71312]: INFO nova.compute.manager [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Took 5.95 seconds to spawn the instance on the hypervisor.
Jul 25 10:09:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:09:12 user nova-compute[71312]: INFO nova.network.neutron [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Updating port bd177392-3e41-4cbf-b629-68a33265fae2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 25 10:09:12 user nova-compute[71312]: INFO nova.compute.manager [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Took 6.75 seconds to build instance.
Jul 25 10:09:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e327bc8-93b8-40f0-825f-961bd05a2d54 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "2e01c123-09c0-4a29-abf0-727f61484747" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.873s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-a9bc76b1-a8d0-4c83-ad03-503d7e77ceea req-fccb454d-e7bf-46d9-9416-b2baeacde9dc service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Received event network-changed-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-a9bc76b1-a8d0-4c83-ad03-503d7e77ceea req-fccb454d-e7bf-46d9-9416-b2baeacde9dc service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Refreshing instance network info cache due to event network-changed-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:09:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a9bc76b1-a8d0-4c83-ad03-503d7e77ceea req-fccb454d-e7bf-46d9-9416-b2baeacde9dc service nova] Acquiring lock "refresh_cache-0a221b2c-60d5-4751-84c1-0f4bfbc3f303" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:09:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a9bc76b1-a8d0-4c83-ad03-503d7e77ceea req-fccb454d-e7bf-46d9-9416-b2baeacde9dc service nova] Acquired lock "refresh_cache-0a221b2c-60d5-4751-84c1-0f4bfbc3f303" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:09:12 user nova-compute[71312]: DEBUG nova.network.neutron [req-a9bc76b1-a8d0-4c83-ad03-503d7e77ceea req-fccb454d-e7bf-46d9-9416-b2baeacde9dc service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Refreshing network info cache for port 504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:09:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-19ee9d7a-2033-49f4-9812-38f4c5ce0c7a req-30d9a49d-bdac-424d-b86e-8d61da92e1ec service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-19ee9d7a-2033-49f4-9812-38f4c5ce0c7a req-30d9a49d-bdac-424d-b86e-8d61da92e1ec service nova] Acquiring lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-19ee9d7a-2033-49f4-9812-38f4c5ce0c7a req-30d9a49d-bdac-424d-b86e-8d61da92e1ec service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-19ee9d7a-2033-49f4-9812-38f4c5ce0c7a req-30d9a49d-bdac-424d-b86e-8d61da92e1ec service nova] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-19ee9d7a-2033-49f4-9812-38f4c5ce0c7a req-30d9a49d-bdac-424d-b86e-8d61da92e1ec service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] No waiting events found dispatching network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:09:12 user nova-compute[71312]: WARNING nova.compute.manager [req-19ee9d7a-2033-49f4-9812-38f4c5ce0c7a req-30d9a49d-bdac-424d-b86e-8d61da92e1ec service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received unexpected event network-vif-plugged-8727a126-c33f-4868-8651-45e7c1f663d2 for instance with vm_state active and task_state deleting.
Jul 25 10:09:12 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:09:12 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Took 1.25 seconds to deallocate network for instance.
Jul 25 10:09:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:09:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquired lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:09:13 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:09:13 user nova-compute[71312]: DEBUG nova.network.neutron [req-a9bc76b1-a8d0-4c83-ad03-503d7e77ceea req-fccb454d-e7bf-46d9-9416-b2baeacde9dc service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Updated VIF entry in instance network info cache for port 504a0f5e-a1d1-4925-94a1-f1a775fa3e1e. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:09:13 user nova-compute[71312]: DEBUG nova.network.neutron [req-a9bc76b1-a8d0-4c83-ad03-503d7e77ceea req-fccb454d-e7bf-46d9-9416-b2baeacde9dc service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Updating instance_info_cache with network_info: [{"id": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "address": "fa:16:3e:dd:c9:ee", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504a0f5e-a1", "ovs_interfaceid": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:09:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a9bc76b1-a8d0-4c83-ad03-503d7e77ceea req-fccb454d-e7bf-46d9-9416-b2baeacde9dc service nova] Releasing lock "refresh_cache-0a221b2c-60d5-4751-84c1-0f4bfbc3f303" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:09:13 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Updating instance_info_cache with network_info: [{"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:09:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Releasing lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:09:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:09:13 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Creating image(s)
Jul 25 10:09:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "/opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "/opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "/opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:13 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9be175c2-20a4-45ce-85a7-ee3c406a4b1f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-c7b9549a-9045-4818-be82-1445899a6c51 req-3844d6ff-d7a1-46cc-aa2f-be6fa766a5c8 service nova] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Received event network-vif-deleted-8727a126-c33f-4868-8651-45e7c1f663d2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "030f187535f4ed94820ab44862fd34086c0705dd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "030f187535f4ed94820ab44862fd34086c0705dd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:13 user nova-compute[71312]: INFO nova.compute.manager [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Took 0.93 seconds to detach 1 volumes for instance.
Jul 25 10:09:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-6c8c2572-6fb1-4b11-8a04-495ee8e61972 req-8d966cf0-02a3-4c00-a4de-fc86f608128c service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-changed-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-6c8c2572-6fb1-4b11-8a04-495ee8e61972 req-8d966cf0-02a3-4c00-a4de-fc86f608128c service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Refreshing instance network info cache due to event network-changed-bd177392-3e41-4cbf-b629-68a33265fae2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:09:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6c8c2572-6fb1-4b11-8a04-495ee8e61972 req-8d966cf0-02a3-4c00-a4de-fc86f608128c service nova] Acquiring lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:09:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6c8c2572-6fb1-4b11-8a04-495ee8e61972 req-8d966cf0-02a3-4c00-a4de-fc86f608128c service nova] Acquired lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:09:14 user nova-compute[71312]: DEBUG nova.network.neutron [req-6c8c2572-6fb1-4b11-8a04-495ee8e61972 req-8d966cf0-02a3-4c00-a4de-fc86f608128c service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Refreshing network info cache for port bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd.part --force-share --output=json" returned: 0 in 0.166s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG nova.virt.images [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] 4bae609f-0f7f-47c9-9c46-bb37ad8e0c9e was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd.part /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG nova.objects.instance [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG nova.network.neutron [req-6c8c2572-6fb1-4b11-8a04-495ee8e61972 req-8d966cf0-02a3-4c00-a4de-fc86f608128c service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Updated VIF entry in instance network info cache for port bd177392-3e41-4cbf-b629-68a33265fae2. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG nova.network.neutron [req-6c8c2572-6fb1-4b11-8a04-495ee8e61972 req-8d966cf0-02a3-4c00-a4de-fc86f608128c service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Updating instance_info_cache with network_info: [{"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:15 user nova-compute[71312]: INFO nova.compute.manager [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Attaching volume e43b6fdd-e65e-4922-a1b2-5112130e30a5 to /dev/vdb
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6c8c2572-6fb1-4b11-8a04-495ee8e61972 req-8d966cf0-02a3-4c00-a4de-fc86f608128c service nova] Releasing lock "refresh_cache-9be175c2-20a4-45ce-85a7-ee3c406a4b1f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd.part /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd.converted" returned: 0 in 0.711s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG os_brick.utils [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.897s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec09950e-4dc3-4355-8235-1d1e76ac2741]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec60e613-9acf-4db1-b5d0-66f5884f7ae0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:15 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Deleted allocations for instance 9fb85501-6210-4bfd-b496-1891c79fd23c
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de22bac-f7de-4d3d-b57c-1300cef38852]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fe6799-065d-4d76-b8ca-a84c1021732d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "030f187535f4ed94820ab44862fd34086c0705dd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.177s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:09:15 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:09:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7ef83e-5dc3-4f08-b670-cb57adf0101a]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG os_brick.utils [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:09:15 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Updating existing volume attachment record: 5eebf36a-cfb8-48b9-8fa8-3349ace7205c {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4ab6e9cb-def1-4fd1-8515-01c6f44954b2 tempest-ServerActionsTestOtherB-766110382 tempest-ServerActionsTestOtherB-766110382-project-member] Lock "9fb85501-6210-4bfd-b496-1891c79fd23c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.750s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "030f187535f4ed94820ab44862fd34086c0705dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "030f187535f4ed94820ab44862fd34086c0705dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'flavor' on Instance uuid 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd,backing_fmt=raw /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd,backing_fmt=raw /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk 1073741824" returned: 0 in 0.054s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "030f187535f4ed94820ab44862fd34086c0705dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:16 user nova-compute[71312]: INFO nova.compute.manager [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Attaching volume 6951dba2-10ca-4230-bcc7-75897a45ea18 to /dev/vdb
Jul 25 10:09:16 user nova-compute[71312]: DEBUG os_brick.utils [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd --force-share --output=json" returned: 0 in 0.175s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'migration_context' on Instance uuid 9be175c2-20a4-45ce-85a7-ee3c406a4b1f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Rebasing disk image.
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[55774ccd-ac2f-4193-a3b6-1b6d6ccfc585]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9799b164-ed94-451d-8ce8-b2ab5c4f3704]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f412e2-697f-4ced-b424-0ba7c399dd6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[652078bd-19d9-429c-96c3-cd43100c327a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 -F raw /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:09:16 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:09:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe7b8d0-e03e-4d53-b86b-eb661b6f1dfa]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG os_brick.utils [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] <== get_connector_properties: return (209ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Updating existing volume attachment record: 728f3ced-9df0-44b7-a01f-4c0bceb4708c {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:09:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 -F raw /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk" returned: 0 in 2.432s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Ensure instance console log exists: /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Start _get_guest_xml network_info=[{"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='7b9a936f9aa6bae09c29eee69cccdc3f',container_format='bare',created_at=2023-07-25T10:07:11Z,direct_url=<?>,disk_format='qcow2',id=4bae609f-0f7f-47c9-9c46-bb37ad8e0c9e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1905762448-shelved',owner='23211f867d6049f5bb1901e03e8dc396',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-25T10:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '8adaebd2-4d4a-45a3-a1ff-b0934d3bb91e', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bmAoNUxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '9be175c2-20a4-45ce-85a7-ee3c406a4b1f', 'attached_at': '', 'detached_at': '', 'volume_id': '50dff2d6-78b1-43e1-a3ab-f729dae8730f', 'serial': '50dff2d6-78b1-43e1-a3ab-f729dae8730f'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:09:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:09:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7b9a936f9aa6bae09c29eee69cccdc3f',container_format='bare',created_at=2023-07-25T10:07:11Z,direct_url=<?>,disk_format='qcow2',id=4bae609f-0f7f-47c9-9c46-bb37ad8e0c9e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1905762448-shelved',owner='23211f867d6049f5bb1901e03e8dc396',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-25T10:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9be175c2-20a4-45ce-85a7-ee3c406a4b1f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bmAoNUxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:09:19 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:09:19 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:09:19 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[89440cf5-10f9-4bdf-95c3-a57236e927fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:09:19 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8923c9-eca3-4b18-85bc-3de9ae30bd53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f] added
Jul 25 10:09:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6e5c52-9931-4548-b403-e21a99425e4f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54a7c74-c469-4748-bf02-9e1b72ff698a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bmAoNUxB {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bmAoNUxB" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[449631c7-7b38-42d3-8bd6-2a56d7e7690a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bmAoNUxB'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f492d1-bcca-47aa-bf96-b32b782fdaea]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7937d410-35a8-41d4-b877-94a48ddbabaf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6cfc0b-e9ba-476c-b09a-c5c7d9081e21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f, portal: 172.16.0.220,3260]
Jul 25 10:09:19 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f, portal: 172.16.0.220,3260] successful.
Jul 25 10:09:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9839c3f9-8a2f-4cd0-a4bd-6704cc0916a4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fe5054-f600-4da4-a21f-45abec3e5f9d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:19 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.059s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50d2e68-92b4-45ca-af73-1fb7cbbba796]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:09:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bmAoNUxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] <== connect_volume: return (1468ms) {'type': 'block', 'scsi_wwn': '23631333337616361', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631333337616361', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1905762448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1905762448',id=17,image_ref='4bae609f-0f7f-47c9-9c46-bb37ad8e0c9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-909376568',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:05:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='23211f867d6049f5bb1901e03e8dc396',ramdisk_id='',reservation_id='r-ker0w51i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1954806993',owner_user_name='tempest-AttachVolumeShelveTestJSON-1954806993-project-member',shelved_at='2023-07-25T10:07:16.760177',shelved_host='user',shelved_image_id='4bae609f-0f7f-47c9-9c46-bb37ad8e0c9e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:09:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec3ee9c206b43448eb6479cad0b437c',uuid=9be175c2-20a4-45ce-85a7-ee3c406a4b1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converting VIF {"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:de:ac,bridge_name='br-int',has_traffic_filtering=True,id=bd177392-3e41-4cbf-b629-68a33265fae2,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd177392-3e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'pci_devices' on Instance uuid 9be175c2-20a4-45ce-85a7-ee3c406a4b1f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:09:20 user nova-compute[71312]:   <uuid>9be175c2-20a4-45ce-85a7-ee3c406a4b1f</uuid>
Jul 25 10:09:20 user nova-compute[71312]:   <name>instance-00000011</name>
Jul 25 10:09:20 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:09:20 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:09:20 user nova-compute[71312]:   <metadata>
Jul 25 10:09:20 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:09:20 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:09:20 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1905762448</nova:name>
Jul 25 10:09:20 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:09:19</nova:creationTime>
Jul 25 10:09:20 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:09:20 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:09:20 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:09:20 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:09:20 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:09:20 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:09:20 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:09:20 user nova-compute[71312]:       <nova:owner>
Jul 25 10:09:20 user nova-compute[71312]:         <nova:user uuid="0ec3ee9c206b43448eb6479cad0b437c">tempest-AttachVolumeShelveTestJSON-1954806993-project-member</nova:user>
Jul 25 10:09:20 user nova-compute[71312]:         <nova:project uuid="23211f867d6049f5bb1901e03e8dc396">tempest-AttachVolumeShelveTestJSON-1954806993</nova:project>
Jul 25 10:09:20 user nova-compute[71312]:       </nova:owner>
Jul 25 10:09:20 user nova-compute[71312]:       <nova:root type="image" uuid="4bae609f-0f7f-47c9-9c46-bb37ad8e0c9e"/>
Jul 25 10:09:20 user nova-compute[71312]:       <nova:ports>
Jul 25 10:09:20 user nova-compute[71312]:         <nova:port uuid="bd177392-3e41-4cbf-b629-68a33265fae2">
Jul 25 10:09:20 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 10:09:20 user nova-compute[71312]:         </nova:port>
Jul 25 10:09:20 user nova-compute[71312]:       </nova:ports>
Jul 25 10:09:20 user nova-compute[71312]:     </nova:instance>
Jul 25 10:09:20 user nova-compute[71312]:   </metadata>
Jul 25 10:09:20 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:09:20 user nova-compute[71312]:     <system>
Jul 25 10:09:20 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:09:20 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:09:20 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:09:20 user nova-compute[71312]:       <entry name="serial">9be175c2-20a4-45ce-85a7-ee3c406a4b1f</entry>
Jul 25 10:09:20 user nova-compute[71312]:       <entry name="uuid">9be175c2-20a4-45ce-85a7-ee3c406a4b1f</entry>
Jul 25 10:09:20 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:09:20 user nova-compute[71312]:     </system>
Jul 25 10:09:20 user nova-compute[71312]:   </sysinfo>
Jul 25 10:09:20 user nova-compute[71312]:   <os>
Jul 25 10:09:20 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:09:20 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:09:20 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:09:20 user nova-compute[71312]:   </os>
Jul 25 10:09:20 user nova-compute[71312]:   <features>
Jul 25 10:09:20 user nova-compute[71312]:     <acpi/>
Jul 25 10:09:20 user nova-compute[71312]:     <apic/>
Jul 25 10:09:20 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:09:20 user nova-compute[71312]:   </features>
Jul 25 10:09:20 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:09:20 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:09:20 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:09:20 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:09:20 user nova-compute[71312]:   </clock>
Jul 25 10:09:20 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:09:20 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:09:20 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:09:20 user nova-compute[71312]:   </cpu>
Jul 25 10:09:20 user nova-compute[71312]:   <devices>
Jul 25 10:09:20 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:09:20 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:09:20 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk"/>
Jul 25 10:09:20 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:09:20 user nova-compute[71312]:     </disk>
Jul 25 10:09:20 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:09:20 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:09:20 user nova-compute[71312]:       <source dev="/dev/sdd"/>
Jul 25 10:09:20 user nova-compute[71312]:       <target dev="vdc" bus="virtio"/>
Jul 25 10:09:20 user nova-compute[71312]:       <serial>50dff2d6-78b1-43e1-a3ab-f729dae8730f</serial>
Jul 25 10:09:20 user nova-compute[71312]:     </disk>
Jul 25 10:09:20 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:09:20 user nova-compute[71312]:       <mac address="fa:16:3e:b0:de:ac"/>
Jul 25 10:09:20 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:09:20 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:09:20 user nova-compute[71312]:       <target dev="tapbd177392-3e"/>
Jul 25 10:09:20 user nova-compute[71312]:     </interface>
Jul 25 10:09:20 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:09:20 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/console.log" append="off"/>
Jul 25 10:09:20 user nova-compute[71312]:     </serial>
Jul 25 10:09:20 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:09:20 user nova-compute[71312]:     <video>
Jul 25 10:09:20 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:09:20 user nova-compute[71312]:     </video>
Jul 25 10:09:20 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:09:20 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:09:20 user nova-compute[71312]:     </rng>
Jul 25 10:09:20 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:09:20 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:09:20 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:09:20 user nova-compute[71312]:     </memballoon>
Jul 25 10:09:20 user nova-compute[71312]:   </devices>
Jul 25 10:09:20 user nova-compute[71312]: </domain>
Jul 25 10:09:20 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1905762448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1905762448',id=17,image_ref='4bae609f-0f7f-47c9-9c46-bb37ad8e0c9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-909376568',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:05:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='23211f867d6049f5bb1901e03e8dc396',ramdisk_id='',reservation_id='r-ker0w51i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1954806993',owner_user_name='tempest-AttachVolumeShelveTestJSON-1954806993-project-member',shelved_at='2023-07-25T10:07:16.760177',shelved_host='user',shelved_image_id='4bae609f-0f7f-47c9-9c46-bb37ad8e0c9e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:09:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec3ee9c206b43448eb6479cad0b437c',uuid=9be175c2-20a4-45ce-85a7-ee3c406a4b1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converting VIF {"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:de:ac,bridge_name='br-int',has_traffic_filtering=True,id=bd177392-3e41-4cbf-b629-68a33265fae2,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd177392-3e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG os_vif [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:de:ac,bridge_name='br-int',has_traffic_filtering=True,id=bd177392-3e41-4cbf-b629-68a33265fae2,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd177392-3e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd177392-3e, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd177392-3e, col_values=(('external_ids', {'iface-id': 'bd177392-3e41-4cbf-b629-68a33265fae2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:de:ac', 'vm-uuid': '9be175c2-20a4-45ce-85a7-ee3c406a4b1f'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:20 user nova-compute[71312]: INFO os_vif [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:de:ac,bridge_name='br-int',has_traffic_filtering=True,id=bd177392-3e41-4cbf-b629-68a33265fae2,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd177392-3e')
Jul 25 10:09:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:09:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] No VIF found with MAC fa:16:3e:b0:de:ac, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:09:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-9c9d9dad-47aa-4a14-8602-dd090d82d53c req-b8df8a62-4ec1-4437-b706-38aaaef41093 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9c9d9dad-47aa-4a14-8602-dd090d82d53c req-b8df8a62-4ec1-4437-b706-38aaaef41093 service nova] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9c9d9dad-47aa-4a14-8602-dd090d82d53c req-b8df8a62-4ec1-4437-b706-38aaaef41093 service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9c9d9dad-47aa-4a14-8602-dd090d82d53c req-b8df8a62-4ec1-4437-b706-38aaaef41093 service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-9c9d9dad-47aa-4a14-8602-dd090d82d53c req-b8df8a62-4ec1-4437-b706-38aaaef41093 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] No waiting events found dispatching network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:09:22 user nova-compute[71312]: WARNING nova.compute.manager [req-9c9d9dad-47aa-4a14-8602-dd090d82d53c req-b8df8a62-4ec1-4437-b706-38aaaef41093 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received unexpected event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 10:09:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AqmrFKjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:09:24 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:09:24 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:09:24 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[608a539a-2e5d-4997-82cf-b25465b81fd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:09:24 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c380c430-ff12-4572-9f98-10dd613cce41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5] added
Jul 25 10:09:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d330e095-79c1-4b37-a299-6b96fa2ac13f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a90662f-91bf-4064-ac8b-db3c03ea5972]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AqmrFKjP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AqmrFKjP" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e710c5d0-c924-4b97-aefb-7c65f79533ac]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AqmrFKjP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28f416e-fb13-429a-8442-e5daaa85714d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c08ed3b-b1a3-40cc-b545-b0d0c497f547]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b1a66c-03d4-4ebb-9971-b4cbdac87a2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5, portal: 172.16.0.220,3260]
Jul 25 10:09:24 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5, portal: 172.16.0.220,3260] successful.
Jul 25 10:09:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce6c377-a064-48ce-b3f1-e39a8a78a92c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[255e933e-ac9c-42e8-b31a-f6ea61569fbc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:24 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 (non-flash)
Jul 25 10:09:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f785881-6740-4b43-ab70-e3fe0b853599]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AqmrFKjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQoFXmYw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:09:24 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:09:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-778eaea3-943e-4661-8f4a-ba033465801b req-bec38e62-24ed-4636-9ca4-3708eb74ffe7 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-778eaea3-943e-4661-8f4a-ba033465801b req-bec38e62-24ed-4636-9ca4-3708eb74ffe7 service nova] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-778eaea3-943e-4661-8f4a-ba033465801b req-bec38e62-24ed-4636-9ca4-3708eb74ffe7 service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-778eaea3-943e-4661-8f4a-ba033465801b req-bec38e62-24ed-4636-9ca4-3708eb74ffe7 service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-778eaea3-943e-4661-8f4a-ba033465801b req-bec38e62-24ed-4636-9ca4-3708eb74ffe7 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] No waiting events found dispatching network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:09:24 user nova-compute[71312]: WARNING nova.compute.manager [req-778eaea3-943e-4661-8f4a-ba033465801b req-bec38e62-24ed-4636-9ca4-3708eb74ffe7 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received unexpected event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 10:09:24 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279764.8700073, 9be175c2-20a4-45ce-85a7-ee3c406a4b1f => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:09:24 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] VM Resumed (Lifecycle Event)
Jul 25 10:09:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:09:24 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Instance spawned successfully.
Jul 25 10:09:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:09:24 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:09:24 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279764.879102, 9be175c2-20a4-45ce-85a7-ee3c406a4b1f => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:09:24 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] VM Started (Lifecycle Event)
Jul 25 10:09:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:09:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:09:25 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:09:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ab5e5fbc-18d1-4433-a8a9-f12caabc5fe0 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.638s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "e47e9004-c0fb-45a4-8f65-78f1685e5105" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "e47e9004-c0fb-45a4-8f65-78f1685e5105" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '26332346464303664', 'path': '/dev/sdg'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332346464303664', 'path': '/dev/sdg'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.862s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:09:25 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:09:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:09:25 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:09:25 user nova-compute[71312]: INFO nova.compute.claims [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Claim successful on node user
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0636d1b3-d5aa-418e-93fe-1fb950040708]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG nova.objects.instance [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:09:25 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c776a5-7267-4fb0-b592-0792f77641a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18] added
Jul 25 10:09:25 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:09:25 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:09:25 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:09:25 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:09:25 user nova-compute[71312]:   <serial>e43b6fdd-e65e-4922-a1b2-5112130e30a5</serial>
Jul 25 10:09:25 user nova-compute[71312]: </disk>
Jul 25 10:09:25 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac4b337-17d2-4d4a-aa91-2644ace4913d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bbf37f-919b-4a46-829e-575cd6504631]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQoFXmYw {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQoFXmYw" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64c8844-862b-43df-9be5-fa3444fb01c6]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sQoFXmYw'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d178b8a-154f-4a70-bebe-98b556e773ba]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[583d7424-8d63-4a69-a174-79f24957d2da]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:25 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:25 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:25 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:25 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:25 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 (non-flash)
Jul 25 10:09:25 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:25 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:25 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:25 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:25 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:25 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 (non-flash)
Jul 25 10:09:25 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --login" returned: 0 in 0.156s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c3e447-985d-42c4-a900-434e97c14c1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18, portal: 172.16.0.220,3260]
Jul 25 10:09:25 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18, portal: 172.16.0.220,3260] successful.
Jul 25 10:09:25 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c648862d-f72a-4873-be99-7c7b9a39a7b3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[da56e7f3-0be0-45e8-8eef-5cafc35c6591]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:26 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:26 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:26 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:26 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:26 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 (non-flash)
Jul 25 10:09:26 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 (non-flash)
Jul 25 10:09:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:26 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:26 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:26 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:26 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:26 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 (non-flash)
Jul 25 10:09:26 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 (non-flash)
Jul 25 10:09:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.523s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] HCTL ('39', '-', '-', 0) found on session 30 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c40de56-d208-47dc-9dcb-c39fb816d283]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQoFXmYw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279751.1418576, 9fb85501-6210-4bfd-b496-1891c79fd23c => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:09:26 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] VM Stopped (Lifecycle Event)
Jul 25 10:09:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-beb2ecbb-4220-47ad-90a7-97c3ca4c1335 None None] [instance: 9fb85501-6210-4bfd-b496-1891c79fd23c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] No VIF found with MAC fa:16:3e:30:3b:71, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.857s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-01e64149-62da-4dd7-a9a9-953f8e852c0a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.857s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:26 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:09:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG nova.policy [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ca2145682dd42388f078b2236c2a196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43f656906af4f9e99608f46026618dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:09:26 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Creating image(s)
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "/opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "/opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "/opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.201s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.581s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] <== connect_volume: return (2443ms) {'type': 'block', 'scsi_wwn': '23862333230373263', 'path': '/dev/sdh'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862333230373263', 'path': '/dev/sdh'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.200s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'flavor' on Instance uuid 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/disk 1073741824" returned: 0 in 0.058s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:09:27 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:09:27 user nova-compute[71312]:   <source dev="/dev/sdh"/>
Jul 25 10:09:27 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:09:27 user nova-compute[71312]:   <serial>6951dba2-10ca-4230-bcc7-75897a45ea18</serial>
Jul 25 10:09:27 user nova-compute[71312]: </disk>
Jul 25 10:09:27 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:09:27 user nova-compute[71312]: INFO nova.compute.claims [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Claim successful on node user
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.203s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Cannot resize image /opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG nova.objects.instance [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lazy-loading 'migration_context' on Instance uuid e47e9004-c0fb-45a4-8f65-78f1685e5105 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Ensure instance console log exists: /opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:09:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No VIF found with MAC fa:16:3e:dd:c9:ee, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Successfully created port: d0c1883d-bc01-4134-9f0f-9a4a61cfa05f {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9569de94-bc98-4317-8360-8999089f464f tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.681s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.891s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Skipping network cache update for instance because it is Building. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Skipping network cache update for instance because it is Building. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:09:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lazy-loading 'info_cache' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:28 user nova-compute[71312]: INFO nova.virt.block_device [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Booting with volume 81927262-7d9a-4a7e-b71b-c0508ba11c5e at /dev/vda
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.policy [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2cfdced66e34e0ba7f9437e71aaee6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30d33a1a8945fdab6798c94a558444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG os_brick.utils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5b7f8d-7c70-4ce9-8736-67cb9fb17c5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[88afbc70-44a7-4b6d-ae84-3c49e3bbf20d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce91808-038b-4957-86b8-7dd8d87a1d1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[89130549-7ad1-456e-8b70-a46e8a6f9908]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:09:28 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:09:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcc81e4-9f26-42a0-ba7d-a4f1660f90c0]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG os_brick.utils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] <== get_connector_properties: return (203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:09:28 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Updating existing volume attachment record: 45ec2f43-0527-4fba-9606-5bc595e9ecd0 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Updating instance_info_cache with network_info: [{"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-a35abe6a-0a8b-4eb2-8781-85b99539d1fc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Successfully updated port: d0c1883d-bc01-4134-9f0f-9a4a61cfa05f {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "refresh_cache-e47e9004-c0fb-45a4-8f65-78f1685e5105" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquired lock "refresh_cache-e47e9004-c0fb-45a4-8f65-78f1685e5105" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-7964c2f3-df9e-4f33-958b-b8bb8e132723 req-f1be0925-efc0-439f-9ef6-6600c72f735f service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Received event network-changed-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-7964c2f3-df9e-4f33-958b-b8bb8e132723 req-f1be0925-efc0-439f-9ef6-6600c72f735f service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Refreshing instance network info cache due to event network-changed-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7964c2f3-df9e-4f33-958b-b8bb8e132723 req-f1be0925-efc0-439f-9ef6-6600c72f735f service nova] Acquiring lock "refresh_cache-e47e9004-c0fb-45a4-8f65-78f1685e5105" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:09:29 user nova-compute[71312]: INFO nova.compute.manager [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Detaching volume e43b6fdd-e65e-4922-a1b2-5112130e30a5
Jul 25 10:09:29 user nova-compute[71312]: INFO nova.virt.block_device [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Attempting to driver detach volume e43b6fdd-e65e-4922-a1b2-5112130e30a5 from mountpoint /dev/vdb
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Attempting to detach device vdb from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:09:29 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:09:29 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:09:29 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:09:29 user nova-compute[71312]:   <serial>e43b6fdd-e65e-4922-a1b2-5112130e30a5</serial>
Jul 25 10:09:29 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:09:29 user nova-compute[71312]: </disk>
Jul 25 10:09:29 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:09:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Successfully detached device vdb from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the persistent domain config.
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:09:29 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:09:29 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:09:29 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:09:29 user nova-compute[71312]:   <serial>e43b6fdd-e65e-4922-a1b2-5112130e30a5</serial>
Jul 25 10:09:29 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:09:29 user nova-compute[71312]: </disk>
Jul 25 10:09:29 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:09:29 user nova-compute[71312]: INFO nova.compute.manager [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Detaching volume 6951dba2-10ca-4230-bcc7-75897a45ea18
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:29 user nova-compute[71312]: INFO nova.virt.block_device [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Attempting to driver detach volume 6951dba2-10ca-4230-bcc7-75897a45ea18 from mountpoint /dev/vdb
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Attempting to detach device vdb from instance 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:09:29 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:09:29 user nova-compute[71312]:   <source dev="/dev/sdh"/>
Jul 25 10:09:29 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:09:29 user nova-compute[71312]:   <serial>6951dba2-10ca-4230-bcc7-75897a45ea18</serial>
Jul 25 10:09:29 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:09:29 user nova-compute[71312]: </disk>
Jul 25 10:09:29 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Successfully detached device vdb from instance 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 from the persistent domain config.
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:09:29 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:09:29 user nova-compute[71312]:   <source dev="/dev/sdh"/>
Jul 25 10:09:29 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:09:29 user nova-compute[71312]:   <serial>6951dba2-10ca-4230-bcc7-75897a45ea18</serial>
Jul 25 10:09:29 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:09:29 user nova-compute[71312]: </disk>
Jul 25 10:09:29 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Updating instance_info_cache with network_info: [{"id": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "address": "fa:16:3e:41:5e:ed", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c1883d-bc", "ovs_interfaceid": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Releasing lock "refresh_cache-e47e9004-c0fb-45a4-8f65-78f1685e5105" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Instance network_info: |[{"id": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "address": "fa:16:3e:41:5e:ed", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c1883d-bc", "ovs_interfaceid": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7964c2f3-df9e-4f33-958b-b8bb8e132723 req-f1be0925-efc0-439f-9ef6-6600c72f735f service nova] Acquired lock "refresh_cache-e47e9004-c0fb-45a4-8f65-78f1685e5105" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-7964c2f3-df9e-4f33-958b-b8bb8e132723 req-f1be0925-efc0-439f-9ef6-6600c72f735f service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Refreshing network info cache for port d0c1883d-bc01-4134-9f0f-9a4a61cfa05f {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Start _get_guest_xml network_info=[{"id": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "address": "fa:16:3e:41:5e:ed", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c1883d-bc", "ovs_interfaceid": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:29 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:09:29 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1024697111',display_name='tempest-VolumesActionsTest-instance-1024697111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1024697111',id=21,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43f656906af4f9e99608f46026618dd',ramdisk_id='',reservation_id='r-xw5y5g0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1049905673',owner_user_name='tempest-VolumesActionsTest-1049905673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:09:27Z,user_data=None,user_id='8ca2145682dd42388f078b2236c2a196',uuid=e47e9004-c0fb-45a4-8f65-78f1685e5105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "address": "fa:16:3e:41:5e:ed", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c1883d-bc", "ovs_interfaceid": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Converting VIF {"id": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "address": "fa:16:3e:41:5e:ed", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c1883d-bc", "ovs_interfaceid": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:5e:ed,bridge_name='br-int',has_traffic_filtering=True,id=d0c1883d-bc01-4134-9f0f-9a4a61cfa05f,network=Network(19db69ce-484c-42ca-932f-688f1da7f111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0c1883d-bc') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lazy-loading 'pci_devices' on Instance uuid e47e9004-c0fb-45a4-8f65-78f1685e5105 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279769.8727505, 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Successfully created port: 7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:09:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Successfully detached device vdb from instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 from the live domain config.
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AqmrFKjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:09:29 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:09:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:09:29 user nova-compute[71312]:   <uuid>e47e9004-c0fb-45a4-8f65-78f1685e5105</uuid>
Jul 25 10:09:29 user nova-compute[71312]:   <name>instance-00000015</name>
Jul 25 10:09:29 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:09:29 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:09:29 user nova-compute[71312]:   <metadata>
Jul 25 10:09:29 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:09:29 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:09:29 user nova-compute[71312]:       <nova:name>tempest-VolumesActionsTest-instance-1024697111</nova:name>
Jul 25 10:09:29 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:09:29</nova:creationTime>
Jul 25 10:09:29 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:09:29 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:09:29 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:09:29 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:09:29 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:09:29 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:09:29 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:09:29 user nova-compute[71312]:       <nova:owner>
Jul 25 10:09:29 user nova-compute[71312]:         <nova:user uuid="8ca2145682dd42388f078b2236c2a196">tempest-VolumesActionsTest-1049905673-project-member</nova:user>
Jul 25 10:09:29 user nova-compute[71312]:         <nova:project uuid="b43f656906af4f9e99608f46026618dd">tempest-VolumesActionsTest-1049905673</nova:project>
Jul 25 10:09:29 user nova-compute[71312]:       </nova:owner>
Jul 25 10:09:29 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:09:29 user nova-compute[71312]:       <nova:ports>
Jul 25 10:09:29 user nova-compute[71312]:         <nova:port uuid="d0c1883d-bc01-4134-9f0f-9a4a61cfa05f">
Jul 25 10:09:29 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 10:09:29 user nova-compute[71312]:         </nova:port>
Jul 25 10:09:29 user nova-compute[71312]:       </nova:ports>
Jul 25 10:09:29 user nova-compute[71312]:     </nova:instance>
Jul 25 10:09:29 user nova-compute[71312]:   </metadata>
Jul 25 10:09:29 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:09:29 user nova-compute[71312]:     <system>
Jul 25 10:09:29 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:09:29 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:09:29 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:09:29 user nova-compute[71312]:       <entry name="serial">e47e9004-c0fb-45a4-8f65-78f1685e5105</entry>
Jul 25 10:09:29 user nova-compute[71312]:       <entry name="uuid">e47e9004-c0fb-45a4-8f65-78f1685e5105</entry>
Jul 25 10:09:29 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:09:29 user nova-compute[71312]:     </system>
Jul 25 10:09:29 user nova-compute[71312]:   </sysinfo>
Jul 25 10:09:29 user nova-compute[71312]:   <os>
Jul 25 10:09:29 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:09:29 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:09:29 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:09:29 user nova-compute[71312]:   </os>
Jul 25 10:09:29 user nova-compute[71312]:   <features>
Jul 25 10:09:29 user nova-compute[71312]:     <acpi/>
Jul 25 10:09:29 user nova-compute[71312]:     <apic/>
Jul 25 10:09:29 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:09:29 user nova-compute[71312]:   </features>
Jul 25 10:09:29 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:09:29 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:09:29 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:09:29 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:09:29 user nova-compute[71312]:   </clock>
Jul 25 10:09:29 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:09:29 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:09:29 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:09:29 user nova-compute[71312]:   </cpu>
Jul 25 10:09:29 user nova-compute[71312]:   <devices>
Jul 25 10:09:29 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:09:29 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:09:29 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/disk"/>
Jul 25 10:09:29 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:09:29 user nova-compute[71312]:     </disk>
Jul 25 10:09:29 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:09:29 user nova-compute[71312]:       <mac address="fa:16:3e:41:5e:ed"/>
Jul 25 10:09:29 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:09:29 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:09:29 user nova-compute[71312]:       <target dev="tapd0c1883d-bc"/>
Jul 25 10:09:29 user nova-compute[71312]:     </interface>
Jul 25 10:09:29 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:09:29 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/console.log" append="off"/>
Jul 25 10:09:29 user nova-compute[71312]:     </serial>
Jul 25 10:09:29 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:09:29 user nova-compute[71312]:     <video>
Jul 25 10:09:29 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:09:29 user nova-compute[71312]:     </video>
Jul 25 10:09:29 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:09:29 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:09:29 user nova-compute[71312]:     </rng>
Jul 25 10:09:29 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:09:29 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:09:29 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:09:29 user nova-compute[71312]:     </memballoon>
Jul 25 10:09:29 user nova-compute[71312]:   </devices>
Jul 25 10:09:29 user nova-compute[71312]: </domain>
Jul 25 10:09:29 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1024697111',display_name='tempest-VolumesActionsTest-instance-1024697111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1024697111',id=21,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43f656906af4f9e99608f46026618dd',ramdisk_id='',reservation_id='r-xw5y5g0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1049905673',owner_user_name='tempest-VolumesActionsTest-1049905673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:09:27Z,user_data=None,user_id='8ca2145682dd42388f078b2236c2a196',uuid=e47e9004-c0fb-45a4-8f65-78f1685e5105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "address": "fa:16:3e:41:5e:ed", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c1883d-bc", "ovs_interfaceid": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Converting VIF {"id": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "address": "fa:16:3e:41:5e:ed", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c1883d-bc", "ovs_interfaceid": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:5e:ed,bridge_name='br-int',has_traffic_filtering=True,id=d0c1883d-bc01-4134-9f0f-9a4a61cfa05f,network=Network(19db69ce-484c-42ca-932f-688f1da7f111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0c1883d-bc') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG os_vif [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:5e:ed,bridge_name='br-int',has_traffic_filtering=True,id=d0c1883d-bc01-4134-9f0f-9a4a61cfa05f,network=Network(19db69ce-484c-42ca-932f-688f1da7f111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0c1883d-bc') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5637a9c-695a-4c19-88e7-55008d43e8db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:09:30 user nova-compute[71312]: No targets found.
Jul 25 10:09:30 user nova-compute[71312]: iSNS:
Jul 25 10:09:30 user nova-compute[71312]: No targets found.
Jul 25 10:09:30 user nova-compute[71312]: STATIC:
Jul 25 10:09:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0
Jul 25 10:09:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:09:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f
Jul 25 10:09:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5
Jul 25 10:09:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087
Jul 25 10:09:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18
Jul 25 10:09:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8
Jul 25 10:09:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:30 user nova-compute[71312]: FIRMWARE:
Jul 25 10:09:30 user nova-compute[71312]: No targets found.
Jul 25 10:09:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:09:30 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:09:30 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0c1883d-bc, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0c1883d-bc, col_values=(('external_ids', {'iface-id': 'd0c1883d-bc01-4134-9f0f-9a4a61cfa05f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:5e:ed', 'vm-uuid': 'e47e9004-c0fb-45a4-8f65-78f1685e5105'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[916fa2d6-6e64-4acb-bc22-012354e3854c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:09:30 user nova-compute[71312]: INFO os_vif [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:5e:ed,bridge_name='br-int',has_traffic_filtering=True,id=d0c1883d-bc01-4134-9f0f-9a4a61cfa05f,network=Network(19db69ce-484c-42ca-932f-688f1da7f111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0c1883d-bc')
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c739a7d-65f7-4386-b059-f03e5bf957e1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a864cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5'): ({'sdg'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Removing single pathed devices sdg {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] No VIF found with MAC fa:16:3e:41:5e:ed, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[965cfe27-f0c0-47fe-8e66-c98f04ca8855]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.034s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c256e8ec-0e96-4771-9602-6bc0d9de605a]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Flushing IO for device /dev/sdg {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[151d08cd-787b-44e1-9998-358703370f92]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279770.2827668, 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:09:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Successfully detached device vdb from instance 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 from the live domain config.
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a570b6-718c-4b63-9b5c-de9b935efb72]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQoFXmYw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:09:30 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c42f5f-a3ea-4348-bea8-7bcf5e9143be]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdd5b84-24f3-4f4d-8533-0318c832e752]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5, portal: 172.16.0.220,3260]
Jul 25 10:09:30 user nova-compute[71312]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5, portal: 172.16.0.220,3260] successful.
Jul 25 10:09:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e43b6fdd-e65e-4922-a1b2-5112130e30a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e8a368-6905-4abe-918c-04b9d064106b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.567s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] <== disconnect_volume: return (568ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.178s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdc01b6-873c-4365-b33d-19360e30c7a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:09:30 user nova-compute[71312]: No targets found.
Jul 25 10:09:30 user nova-compute[71312]: iSNS:
Jul 25 10:09:30 user nova-compute[71312]: No targets found.
Jul 25 10:09:30 user nova-compute[71312]: STATIC:
Jul 25 10:09:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0
Jul 25 10:09:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:09:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f
Jul 25 10:09:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087
Jul 25 10:09:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18
Jul 25 10:09:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8
Jul 25 10:09:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:09:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:09:30 user nova-compute[71312]: FIRMWARE:
Jul 25 10:09:30 user nova-compute[71312]: No targets found.
Jul 25 10:09:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:09:30 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:09:30 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-7964c2f3-df9e-4f33-958b-b8bb8e132723 req-f1be0925-efc0-439f-9ef6-6600c72f735f service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Updated VIF entry in instance network info cache for port d0c1883d-bc01-4134-9f0f-9a4a61cfa05f. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-7964c2f3-df9e-4f33-958b-b8bb8e132723 req-f1be0925-efc0-439f-9ef6-6600c72f735f service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Updating instance_info_cache with network_info: [{"id": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "address": "fa:16:3e:41:5e:ed", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c1883d-bc", "ovs_interfaceid": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa016e34-da66-450f-ba70-e4070123bd43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7964c2f3-df9e-4f33-958b-b8bb8e132723 req-f1be0925-efc0-439f-9ef6-6600c72f735f service nova] Releasing lock "refresh_cache-e47e9004-c0fb-45a4-8f65-78f1685e5105" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70b4435-a4b9-4f93-8364-23aecbd11d9a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:30 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 (non-flash)
Jul 25 10:09:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a85f2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18'): ({'sdh'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Removing single pathed devices sdh {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab354529-65d9-46e7-abf2-0ec8c471d080]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[48048625-9ed6-4f19-b075-22703c0c6dff]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Flushing IO for device /dev/sdh {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7244210f-fd72-40d0-9b3a-4da99ebf0238]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2998be-df29-467d-b166-2c1206cca408]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] SCSI volumes sdh have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[23553c1d-e19c-4db3-b611-e9cab31083bb]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f6611a-398e-46b3-b1c6-7b86fb052c47]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18, portal: 172.16.0.220,3260]
Jul 25 10:09:30 user nova-compute[71312]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18, portal: 172.16.0.220,3260] successful.
Jul 25 10:09:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6951dba2-10ca-4230-bcc7-75897a45ea18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[76709c68-4140-4e91-a5ec-c154a4961c68]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.469s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] <== disconnect_volume: return (647ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Successfully updated port: 7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquired lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:09:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-de8a96e9-8395-4ed2-a8d0-6c3b37225f60 req-f9131f07-6cc7-4e74-8753-46b1d6d6f0bb service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received event network-changed-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-de8a96e9-8395-4ed2-a8d0-6c3b37225f60 req-f9131f07-6cc7-4e74-8753-46b1d6d6f0bb service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Refreshing instance network info cache due to event network-changed-7e6bcfd4-3491-4be2-819d-92ed4bed42f7. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-de8a96e9-8395-4ed2-a8d0-6c3b37225f60 req-f9131f07-6cc7-4e74-8753-46b1d6d6f0bb service nova] Acquiring lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG nova.objects.instance [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'flavor' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-09eab114-4820-4a8b-a926-e2d43d697a8a tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.301s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Updating instance_info_cache with network_info: [{"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Releasing lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Instance network_info: |[{"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-de8a96e9-8395-4ed2-a8d0-6c3b37225f60 req-f9131f07-6cc7-4e74-8753-46b1d6d6f0bb service nova] Acquired lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG nova.network.neutron [req-de8a96e9-8395-4ed2-a8d0-6c3b37225f60 req-f9131f07-6cc7-4e74-8753-46b1d6d6f0bb service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Refreshing network info cache for port 7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:31 user nova-compute[71312]: DEBUG nova.objects.instance [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'flavor' on Instance uuid 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-798a34c7-34e5-4150-8c6c-44c51becfc40 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.691s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:09:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:09:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:09:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:09:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7609MB free_disk=25.35330581665039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:09:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.network.neutron [req-de8a96e9-8395-4ed2-a8d0-6c3b37225f60 req-f9131f07-6cc7-4e74-8753-46b1d6d6f0bb service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Updated VIF entry in instance network info cache for port 7e6bcfd4-3491-4be2-819d-92ed4bed42f7. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.network.neutron [req-de8a96e9-8395-4ed2-a8d0-6c3b37225f60 req-f9131f07-6cc7-4e74-8753-46b1d6d6f0bb service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Updating instance_info_cache with network_info: [{"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-de8a96e9-8395-4ed2-a8d0-6c3b37225f60 req-f9131f07-6cc7-4e74-8753-46b1d6d6f0bb service nova] Releasing lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-876eb5fa-a5b0-4593-8ef0-425c5de9dbdb req-283b4973-6192-426c-b7fd-58e4b130946c service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Received event network-vif-plugged-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-876eb5fa-a5b0-4593-8ef0-425c5de9dbdb req-283b4973-6192-426c-b7fd-58e4b130946c service nova] Acquiring lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-876eb5fa-a5b0-4593-8ef0-425c5de9dbdb req-283b4973-6192-426c-b7fd-58e4b130946c service nova] Lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-876eb5fa-a5b0-4593-8ef0-425c5de9dbdb req-283b4973-6192-426c-b7fd-58e4b130946c service nova] Lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-876eb5fa-a5b0-4593-8ef0-425c5de9dbdb req-283b4973-6192-426c-b7fd-58e4b130946c service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] No waiting events found dispatching network-vif-plugged-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:09:33 user nova-compute[71312]: WARNING nova.compute.manager [req-876eb5fa-a5b0-4593-8ef0-425c5de9dbdb req-283b4973-6192-426c-b7fd-58e4b130946c service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Received unexpected event network-vif-plugged-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f for instance with vm_state building and task_state spawning.
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-876eb5fa-a5b0-4593-8ef0-425c5de9dbdb req-283b4973-6192-426c-b7fd-58e4b130946c service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Received event network-vif-plugged-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-876eb5fa-a5b0-4593-8ef0-425c5de9dbdb req-283b4973-6192-426c-b7fd-58e4b130946c service nova] Acquiring lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-876eb5fa-a5b0-4593-8ef0-425c5de9dbdb req-283b4973-6192-426c-b7fd-58e4b130946c service nova] Lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-876eb5fa-a5b0-4593-8ef0-425c5de9dbdb req-283b4973-6192-426c-b7fd-58e4b130946c service nova] Lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-876eb5fa-a5b0-4593-8ef0-425c5de9dbdb req-283b4973-6192-426c-b7fd-58e4b130946c service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] No waiting events found dispatching network-vif-plugged-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:09:33 user nova-compute[71312]: WARNING nova.compute.manager [req-876eb5fa-a5b0-4593-8ef0-425c5de9dbdb req-283b4973-6192-426c-b7fd-58e4b130946c service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Received unexpected event network-vif-plugged-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f for instance with vm_state building and task_state spawning.
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 3a5a9026-70f9-42fd-b8f8-66fc893ced35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9be175c2-20a4-45ce-85a7-ee3c406a4b1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 2e01c123-09c0-4a29-abf0-727f61484747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance e47e9004-c0fb-45a4-8f65-78f1685e5105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance cba49a3e-0ffe-4ea2-a956-bb41c178dd38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:09:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279774.375565, e47e9004-c0fb-45a4-8f65-78f1685e5105 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:09:34 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] VM Resumed (Lifecycle Event)
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:09:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Instance spawned successfully.
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:34 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279774.3783894, e47e9004-c0fb-45a4-8f65-78f1685e5105 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:09:34 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] VM Started (Lifecycle Event)
Jul 25 10:09:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:09:34 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:09:34 user nova-compute[71312]: INFO nova.compute.manager [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Took 7.76 seconds to spawn the instance on the hypervisor.
Jul 25 10:09:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:09:34 user nova-compute[71312]: INFO nova.compute.manager [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Took 9.07 seconds to build instance.
Jul 25 10:09:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-690463e0-2f7b-4bc9-b817-d5e523b2b369 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "e47e9004-c0fb-45a4-8f65-78f1685e5105" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.191s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:09:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:09:37 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Creating image(s)
Jul 25 10:09:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:09:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Ensure instance console log exists: /opt/stack/data/nova/instances/cba49a3e-0ffe-4ea2-a956-bb41c178dd38/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:09:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Start _get_guest_xml network_info=[{"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '45ec2f43-0527-4fba-9606-5bc595e9ecd0', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRHCGBOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cba49a3e-0ffe-4ea2-a956-bb41c178dd38', 'attached_at': '', 'detached_at': '', 'volume_id': '81927262-7d9a-4a7e-b71b-c0508ba11c5e', 'serial': '81927262-7d9a-4a7e-b71b-c0508ba11c5e'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:09:38 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:09:38 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRHCGBOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:09:38 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:09:38 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:09:38 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260" returned: 21 in 0.052s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2510460-59b3-482c-b887-e1764672a1d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:09:38 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6decca8-3efe-40ca-86a2-153fea2ecefd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e] added
Jul 25 10:09:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceac559-9378-413d-ad3f-1e89f69750fb]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d08ee8b-709f-482d-96e1-545568bb2cef]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bRHCGBOA {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bRHCGBOA" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fbce8e-5f43-47f2-b065-1a46da090004]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bRHCGBOA'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc278b88-de58-4978-a2fe-d4ef84c20166]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb0a5e1-9425-4902-bd5d-e76c6017a337]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[65842216-fcf3-452f-a0e4-3f3695084199]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260]
Jul 25 10:09:38 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260] successful.
Jul 25 10:09:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c600934e-7a31-4742-8baa-9a76f2e9dfb7]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d18840-8667-45a4-8394-5d126b32bd0a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:09:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:09:38 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:09:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd110478-49e6-433a-ba6d-ff1e34f3bf3d]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:09:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRHCGBOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23466653362353862', 'path': '/dev/sdg'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466653362353862', 'path': '/dev/sdg'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-87945462',display_name='tempest-ServerActionsTestOtherA-server-87945462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-87945462',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7/PiN27E1zNONLGfU75gjTzl6TjLJTSPguo/w/NLGiNWvcFBQAXJk/RsZr2x3/TDzaN8UL9NG26qh75+qbwT35akc6FqjZaWZn3poJMiar+SGmPPXZDxAQP/CqYmNQIw==',key_name='tempest-keypair-2143034637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c30d33a1a8945fdab6798c94a558444',ramdisk_id='',reservation_id='r-emt2yer0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-408585031',owner_user_name='tempest-ServerActionsTestOtherA-408585031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:09:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfdced66e34e0ba7f9437e71aaee6a',uuid=cba49a3e-0ffe-4ea2-a956-bb41c178dd38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converting VIF {"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2e:f4,bridge_name='br-int',has_traffic_filtering=True,id=7e6bcfd4-3491-4be2-819d-92ed4bed42f7,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6bcfd4-34') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'pci_devices' on Instance uuid cba49a3e-0ffe-4ea2-a956-bb41c178dd38 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:09:39 user nova-compute[71312]:   <uuid>cba49a3e-0ffe-4ea2-a956-bb41c178dd38</uuid>
Jul 25 10:09:39 user nova-compute[71312]:   <name>instance-00000016</name>
Jul 25 10:09:39 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:09:39 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:09:39 user nova-compute[71312]:   <metadata>
Jul 25 10:09:39 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:09:39 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:09:39 user nova-compute[71312]:       <nova:name>tempest-ServerActionsTestOtherA-server-87945462</nova:name>
Jul 25 10:09:39 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:09:38</nova:creationTime>
Jul 25 10:09:39 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:09:39 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:09:39 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:09:39 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:09:39 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:09:39 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:09:39 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:09:39 user nova-compute[71312]:       <nova:owner>
Jul 25 10:09:39 user nova-compute[71312]:         <nova:user uuid="c2cfdced66e34e0ba7f9437e71aaee6a">tempest-ServerActionsTestOtherA-408585031-project-member</nova:user>
Jul 25 10:09:39 user nova-compute[71312]:         <nova:project uuid="9c30d33a1a8945fdab6798c94a558444">tempest-ServerActionsTestOtherA-408585031</nova:project>
Jul 25 10:09:39 user nova-compute[71312]:       </nova:owner>
Jul 25 10:09:39 user nova-compute[71312]:       <nova:ports>
Jul 25 10:09:39 user nova-compute[71312]:         <nova:port uuid="7e6bcfd4-3491-4be2-819d-92ed4bed42f7">
Jul 25 10:09:39 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:09:39 user nova-compute[71312]:         </nova:port>
Jul 25 10:09:39 user nova-compute[71312]:       </nova:ports>
Jul 25 10:09:39 user nova-compute[71312]:     </nova:instance>
Jul 25 10:09:39 user nova-compute[71312]:   </metadata>
Jul 25 10:09:39 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:09:39 user nova-compute[71312]:     <system>
Jul 25 10:09:39 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:09:39 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:09:39 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:09:39 user nova-compute[71312]:       <entry name="serial">cba49a3e-0ffe-4ea2-a956-bb41c178dd38</entry>
Jul 25 10:09:39 user nova-compute[71312]:       <entry name="uuid">cba49a3e-0ffe-4ea2-a956-bb41c178dd38</entry>
Jul 25 10:09:39 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:09:39 user nova-compute[71312]:     </system>
Jul 25 10:09:39 user nova-compute[71312]:   </sysinfo>
Jul 25 10:09:39 user nova-compute[71312]:   <os>
Jul 25 10:09:39 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:09:39 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:09:39 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:09:39 user nova-compute[71312]:   </os>
Jul 25 10:09:39 user nova-compute[71312]:   <features>
Jul 25 10:09:39 user nova-compute[71312]:     <acpi/>
Jul 25 10:09:39 user nova-compute[71312]:     <apic/>
Jul 25 10:09:39 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:09:39 user nova-compute[71312]:   </features>
Jul 25 10:09:39 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:09:39 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:09:39 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:09:39 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:09:39 user nova-compute[71312]:   </clock>
Jul 25 10:09:39 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:09:39 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:09:39 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:09:39 user nova-compute[71312]:   </cpu>
Jul 25 10:09:39 user nova-compute[71312]:   <devices>
Jul 25 10:09:39 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:09:39 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:09:39 user nova-compute[71312]:       <source dev="/dev/sdg"/>
Jul 25 10:09:39 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:09:39 user nova-compute[71312]:       <serial>81927262-7d9a-4a7e-b71b-c0508ba11c5e</serial>
Jul 25 10:09:39 user nova-compute[71312]:     </disk>
Jul 25 10:09:39 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:09:39 user nova-compute[71312]:       <mac address="fa:16:3e:39:2e:f4"/>
Jul 25 10:09:39 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:09:39 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:09:39 user nova-compute[71312]:       <target dev="tap7e6bcfd4-34"/>
Jul 25 10:09:39 user nova-compute[71312]:     </interface>
Jul 25 10:09:39 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:09:39 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/cba49a3e-0ffe-4ea2-a956-bb41c178dd38/console.log" append="off"/>
Jul 25 10:09:39 user nova-compute[71312]:     </serial>
Jul 25 10:09:39 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:09:39 user nova-compute[71312]:     <video>
Jul 25 10:09:39 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:09:39 user nova-compute[71312]:     </video>
Jul 25 10:09:39 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:09:39 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:09:39 user nova-compute[71312]:     </rng>
Jul 25 10:09:39 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:09:39 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:09:39 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:09:39 user nova-compute[71312]:     </memballoon>
Jul 25 10:09:39 user nova-compute[71312]:   </devices>
Jul 25 10:09:39 user nova-compute[71312]: </domain>
Jul 25 10:09:39 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-87945462',display_name='tempest-ServerActionsTestOtherA-server-87945462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-87945462',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7/PiN27E1zNONLGfU75gjTzl6TjLJTSPguo/w/NLGiNWvcFBQAXJk/RsZr2x3/TDzaN8UL9NG26qh75+qbwT35akc6FqjZaWZn3poJMiar+SGmPPXZDxAQP/CqYmNQIw==',key_name='tempest-keypair-2143034637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c30d33a1a8945fdab6798c94a558444',ramdisk_id='',reservation_id='r-emt2yer0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-408585031',owner_user_name='tempest-ServerActionsTestOtherA-408585031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:09:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfdced66e34e0ba7f9437e71aaee6a',uuid=cba49a3e-0ffe-4ea2-a956-bb41c178dd38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converting VIF {"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2e:f4,bridge_name='br-int',has_traffic_filtering=True,id=7e6bcfd4-3491-4be2-819d-92ed4bed42f7,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6bcfd4-34') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG os_vif [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2e:f4,bridge_name='br-int',has_traffic_filtering=True,id=7e6bcfd4-3491-4be2-819d-92ed4bed42f7,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6bcfd4-34') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e6bcfd4-34, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e6bcfd4-34, col_values=(('external_ids', {'iface-id': '7e6bcfd4-3491-4be2-819d-92ed4bed42f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:2e:f4', 'vm-uuid': 'cba49a3e-0ffe-4ea2-a956-bb41c178dd38'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:39 user nova-compute[71312]: INFO os_vif [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2e:f4,bridge_name='br-int',has_traffic_filtering=True,id=7e6bcfd4-3491-4be2-819d-92ed4bed42f7,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6bcfd4-34')
Jul 25 10:09:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:09:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] No VIF found with MAC fa:16:3e:39:2e:f4, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:09:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-5d6b55b2-ddbe-4cd1-acfb-0acd74eaa9f5 req-165391b2-0d04-43a7-b23d-17d8bd137ce4 service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received event network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5d6b55b2-ddbe-4cd1-acfb-0acd74eaa9f5 req-165391b2-0d04-43a7-b23d-17d8bd137ce4 service nova] Acquiring lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5d6b55b2-ddbe-4cd1-acfb-0acd74eaa9f5 req-165391b2-0d04-43a7-b23d-17d8bd137ce4 service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5d6b55b2-ddbe-4cd1-acfb-0acd74eaa9f5 req-165391b2-0d04-43a7-b23d-17d8bd137ce4 service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-5d6b55b2-ddbe-4cd1-acfb-0acd74eaa9f5 req-165391b2-0d04-43a7-b23d-17d8bd137ce4 service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] No waiting events found dispatching network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:09:41 user nova-compute[71312]: WARNING nova.compute.manager [req-5d6b55b2-ddbe-4cd1-acfb-0acd74eaa9f5 req-165391b2-0d04-43a7-b23d-17d8bd137ce4 service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received unexpected event network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 for instance with vm_state building and task_state spawning.
Jul 25 10:09:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279783.1348574, cba49a3e-0ffe-4ea2-a956-bb41c178dd38 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:09:43 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] VM Resumed (Lifecycle Event)
Jul 25 10:09:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Instance spawned successfully.
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:09:43 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279783.1349564, cba49a3e-0ffe-4ea2-a956-bb41c178dd38 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:09:43 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] VM Started (Lifecycle Event)
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:09:43 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:09:43 user nova-compute[71312]: INFO nova.compute.manager [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Took 5.41 seconds to spawn the instance on the hypervisor.
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:09:43 user nova-compute[71312]: INFO nova.compute.manager [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Took 16.10 seconds to build instance.
Jul 25 10:09:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ee4d0e0c-fed6-4e02-ae0f-8ff9955d60d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.293s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-d021e665-72fd-4403-8f20-ddec634f3455 req-789e3846-b35e-425d-b9dd-1ffca06f6492 service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received event network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d021e665-72fd-4403-8f20-ddec634f3455 req-789e3846-b35e-425d-b9dd-1ffca06f6492 service nova] Acquiring lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d021e665-72fd-4403-8f20-ddec634f3455 req-789e3846-b35e-425d-b9dd-1ffca06f6492 service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d021e665-72fd-4403-8f20-ddec634f3455 req-789e3846-b35e-425d-b9dd-1ffca06f6492 service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:09:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-d021e665-72fd-4403-8f20-ddec634f3455 req-789e3846-b35e-425d-b9dd-1ffca06f6492 service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] No waiting events found dispatching network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:09:43 user nova-compute[71312]: WARNING nova.compute.manager [req-d021e665-72fd-4403-8f20-ddec634f3455 req-789e3846-b35e-425d-b9dd-1ffca06f6492 service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received unexpected event network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 for instance with vm_state active and task_state None.
Jul 25 10:09:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:09:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:02 user nova-compute[71312]: INFO nova.compute.manager [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Terminating instance
Jul 25 10:10:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:10:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-760439e2-2701-4934-a5d3-6982f05e7bf0 req-69837531-a289-40d2-be0c-1a7403ec7c51 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-vif-unplugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-760439e2-2701-4934-a5d3-6982f05e7bf0 req-69837531-a289-40d2-be0c-1a7403ec7c51 service nova] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-760439e2-2701-4934-a5d3-6982f05e7bf0 req-69837531-a289-40d2-be0c-1a7403ec7c51 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-760439e2-2701-4934-a5d3-6982f05e7bf0 req-69837531-a289-40d2-be0c-1a7403ec7c51 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-760439e2-2701-4934-a5d3-6982f05e7bf0 req-69837531-a289-40d2-be0c-1a7403ec7c51 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] No waiting events found dispatching network-vif-unplugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-760439e2-2701-4934-a5d3-6982f05e7bf0 req-69837531-a289-40d2-be0c-1a7403ec7c51 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-vif-unplugged-c8954e08-0e8d-41ae-9080-1eb363124b32 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:10:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Instance destroyed successfully.
Jul 25 10:10:03 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'resources' on Instance uuid a35abe6a-0a8b-4eb2-8781-85b99539d1fc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-144544124',display_name='tempest-AttachVolumeTestJSON-server-144544124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-144544124',id=1,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXz0IZaYzGqFbEgiNbRhFKdSJm7XWgEwVt5cEq+cvPNuokJAodyfDggfS0UAjnFMJC0mA942niA5C8O8meI4xtkMoQ/wHBJsXHFttAfgGOUxF17NM8ZbF6FsKSU7eOZoQ==',key_name='tempest-keypair-2122772756',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68cb9228183844d5853c6c2a35f2658f',ramdisk_id='',reservation_id='r-il07codx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095711794',owner_user_name='tempest-AttachVolumeTestJSON-1095711794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48272d2a58644b2b8b6a9c42b51c746',uuid=a35abe6a-0a8b-4eb2-8781-85b99539d1fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converting VIF {"id": "c8954e08-0e8d-41ae-9080-1eb363124b32", "address": "fa:16:3e:3d:6d:80", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8954e08-0e", "ovs_interfaceid": "c8954e08-0e8d-41ae-9080-1eb363124b32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG os_vif [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8954e08-0e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:03 user nova-compute[71312]: INFO os_vif [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:6d:80,bridge_name='br-int',has_traffic_filtering=True,id=c8954e08-0e8d-41ae-9080-1eb363124b32,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8954e08-0e')
Jul 25 10:10:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Deleting instance files /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc_del
Jul 25 10:10:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Deletion of /opt/stack/data/nova/instances/a35abe6a-0a8b-4eb2-8781-85b99539d1fc_del complete
Jul 25 10:10:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:03 user nova-compute[71312]: INFO nova.compute.manager [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Took 0.75 seconds to destroy the instance on the hypervisor.
Jul 25 10:10:03 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:10:03 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:10:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:04 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:10:04 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Took 0.96 seconds to deallocate network for instance.
Jul 25 10:10:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:10:05 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:10:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:05 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Deleted allocations for instance a35abe6a-0a8b-4eb2-8781-85b99539d1fc
Jul 25 10:10:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6376923c-5d37-4449-a661-9c1444de652d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.481s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-f52af5b8-4cc0-42c7-8105-28482d6625ff req-1e88b678-50f3-4b39-84b9-b74edbcf1b22 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f52af5b8-4cc0-42c7-8105-28482d6625ff req-1e88b678-50f3-4b39-84b9-b74edbcf1b22 service nova] Acquiring lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f52af5b8-4cc0-42c7-8105-28482d6625ff req-1e88b678-50f3-4b39-84b9-b74edbcf1b22 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f52af5b8-4cc0-42c7-8105-28482d6625ff req-1e88b678-50f3-4b39-84b9-b74edbcf1b22 service nova] Lock "a35abe6a-0a8b-4eb2-8781-85b99539d1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-f52af5b8-4cc0-42c7-8105-28482d6625ff req-1e88b678-50f3-4b39-84b9-b74edbcf1b22 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] No waiting events found dispatching network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:05 user nova-compute[71312]: WARNING nova.compute.manager [req-f52af5b8-4cc0-42c7-8105-28482d6625ff req-1e88b678-50f3-4b39-84b9-b74edbcf1b22 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received unexpected event network-vif-plugged-c8954e08-0e8d-41ae-9080-1eb363124b32 for instance with vm_state deleted and task_state None.
Jul 25 10:10:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-f52af5b8-4cc0-42c7-8105-28482d6625ff req-1e88b678-50f3-4b39-84b9-b74edbcf1b22 service nova] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Received event network-vif-deleted-c8954e08-0e8d-41ae-9080-1eb363124b32 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-40cc0fce-d8a5-44e2-9751-b4a039a1c31d req-6818d646-070d-4772-b3b4-cd0fd396dd65 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-changed-99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-40cc0fce-d8a5-44e2-9751-b4a039a1c31d req-6818d646-070d-4772-b3b4-cd0fd396dd65 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing instance network info cache due to event network-changed-99d7dcea-66cf-481f-9032-88bc7ca0f945. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:10:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-40cc0fce-d8a5-44e2-9751-b4a039a1c31d req-6818d646-070d-4772-b3b4-cd0fd396dd65 service nova] Acquiring lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:10:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-40cc0fce-d8a5-44e2-9751-b4a039a1c31d req-6818d646-070d-4772-b3b4-cd0fd396dd65 service nova] Acquired lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:10:05 user nova-compute[71312]: DEBUG nova.network.neutron [req-40cc0fce-d8a5-44e2-9751-b4a039a1c31d req-6818d646-070d-4772-b3b4-cd0fd396dd65 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Refreshing network info cache for port 99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:10:06 user nova-compute[71312]: DEBUG nova.network.neutron [req-40cc0fce-d8a5-44e2-9751-b4a039a1c31d req-6818d646-070d-4772-b3b4-cd0fd396dd65 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updated VIF entry in instance network info cache for port 99d7dcea-66cf-481f-9032-88bc7ca0f945. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:10:06 user nova-compute[71312]: DEBUG nova.network.neutron [req-40cc0fce-d8a5-44e2-9751-b4a039a1c31d req-6818d646-070d-4772-b3b4-cd0fd396dd65 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updating instance_info_cache with network_info: [{"id": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "address": "fa:16:3e:cc:e8:98", "network": {"id": "d9bd4b73-ff7d-466e-9d5a-92a66713f345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2138648596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d7dcea-66", "ovs_interfaceid": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59952b1f-a979-435c-b62a-121d29086ca8", "address": "fa:16:3e:50:41:f5", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59952b1f-a9", "ovs_interfaceid": "59952b1f-a979-435c-b62a-121d29086ca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "303d5eaf-9f56-46f8-a525-38e786edba0f", "address": "fa:16:3e:60:b3:14", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303d5eaf-9f", "ovs_interfaceid": "303d5eaf-9f56-46f8-a525-38e786edba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eee5f90-639a-4724-9758-0689e4548963", "address": "fa:16:3e:7c:7a:10", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee5f90-63", "ovs_interfaceid": "2eee5f90-639a-4724-9758-0689e4548963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "address": "fa:16:3e:71:74:23", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6dbc98-d0", "ovs_interfaceid": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "address": "fa:16:3e:7c:02:0f", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f11c7c-09", "ovs_interfaceid": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "address": "fa:16:3e:dc:39:ca", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca21dc2-49", "ovs_interfaceid": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:10:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-40cc0fce-d8a5-44e2-9751-b4a039a1c31d req-6818d646-070d-4772-b3b4-cd0fd396dd65 service nova] Releasing lock "refresh_cache-3a5a9026-70f9-42fd-b8f8-66fc893ced35" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:08 user nova-compute[71312]: INFO nova.compute.manager [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Terminating instance
Jul 25 10:10:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-93240bea-1ce4-4e7e-80b7-fe257127729e req-840a7447-98bd-4161-b4d2-3580fcea057e service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-unplugged-99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-93240bea-1ce4-4e7e-80b7-fe257127729e req-840a7447-98bd-4161-b4d2-3580fcea057e service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-93240bea-1ce4-4e7e-80b7-fe257127729e req-840a7447-98bd-4161-b4d2-3580fcea057e service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-93240bea-1ce4-4e7e-80b7-fe257127729e req-840a7447-98bd-4161-b4d2-3580fcea057e service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-93240bea-1ce4-4e7e-80b7-fe257127729e req-840a7447-98bd-4161-b4d2-3580fcea057e service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-unplugged-99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-93240bea-1ce4-4e7e-80b7-fe257127729e req-840a7447-98bd-4161-b4d2-3580fcea057e service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-unplugged-99d7dcea-66cf-481f-9032-88bc7ca0f945 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-1437894d-b746-4520-b9cc-929fabaf4df7 req-6b423596-79b7-468d-816d-df2cea3ff1b6 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-unplugged-59952b1f-a979-435c-b62a-121d29086ca8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1437894d-b746-4520-b9cc-929fabaf4df7 req-6b423596-79b7-468d-816d-df2cea3ff1b6 service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1437894d-b746-4520-b9cc-929fabaf4df7 req-6b423596-79b7-468d-816d-df2cea3ff1b6 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1437894d-b746-4520-b9cc-929fabaf4df7 req-6b423596-79b7-468d-816d-df2cea3ff1b6 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-1437894d-b746-4520-b9cc-929fabaf4df7 req-6b423596-79b7-468d-816d-df2cea3ff1b6 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-unplugged-59952b1f-a979-435c-b62a-121d29086ca8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-1437894d-b746-4520-b9cc-929fabaf4df7 req-6b423596-79b7-468d-816d-df2cea3ff1b6 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-unplugged-59952b1f-a979-435c-b62a-121d29086ca8 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-6d6b6a00-ab9e-477d-b130-a6bf37b33418 req-937df29d-2512-4e45-ab95-892c44f9f598 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-unplugged-40f11c7c-09cf-4b21-acb5-a6281b4421ec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6d6b6a00-ab9e-477d-b130-a6bf37b33418 req-937df29d-2512-4e45-ab95-892c44f9f598 service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6d6b6a00-ab9e-477d-b130-a6bf37b33418 req-937df29d-2512-4e45-ab95-892c44f9f598 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6d6b6a00-ab9e-477d-b130-a6bf37b33418 req-937df29d-2512-4e45-ab95-892c44f9f598 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-6d6b6a00-ab9e-477d-b130-a6bf37b33418 req-937df29d-2512-4e45-ab95-892c44f9f598 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-unplugged-40f11c7c-09cf-4b21-acb5-a6281b4421ec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-6d6b6a00-ab9e-477d-b130-a6bf37b33418 req-937df29d-2512-4e45-ab95-892c44f9f598 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-unplugged-40f11c7c-09cf-4b21-acb5-a6281b4421ec for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Instance destroyed successfully.
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lazy-loading 'resources' on Instance uuid 3a5a9026-70f9-42fd-b8f8-66fc893ced35 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:08:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:08:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "address": "fa:16:3e:cc:e8:98", "network": {"id": "d9bd4b73-ff7d-466e-9d5a-92a66713f345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2138648596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d7dcea-66", "ovs_interfaceid": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "address": "fa:16:3e:cc:e8:98", "network": {"id": "d9bd4b73-ff7d-466e-9d5a-92a66713f345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2138648596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d7dcea-66", "ovs_interfaceid": "99d7dcea-66cf-481f-9032-88bc7ca0f945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e8:98,bridge_name='br-int',has_traffic_filtering=True,id=99d7dcea-66cf-481f-9032-88bc7ca0f945,network=Network(d9bd4b73-ff7d-466e-9d5a-92a66713f345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d7dcea-66') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e8:98,bridge_name='br-int',has_traffic_filtering=True,id=99d7dcea-66cf-481f-9032-88bc7ca0f945,network=Network(d9bd4b73-ff7d-466e-9d5a-92a66713f345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d7dcea-66') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99d7dcea-66, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: INFO os_vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e8:98,bridge_name='br-int',has_traffic_filtering=True,id=99d7dcea-66cf-481f-9032-88bc7ca0f945,network=Network(d9bd4b73-ff7d-466e-9d5a-92a66713f345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d7dcea-66')
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:08:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:08:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59952b1f-a979-435c-b62a-121d29086ca8", "address": "fa:16:3e:50:41:f5", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59952b1f-a9", "ovs_interfaceid": "59952b1f-a979-435c-b62a-121d29086ca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "59952b1f-a979-435c-b62a-121d29086ca8", "address": "fa:16:3e:50:41:f5", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59952b1f-a9", "ovs_interfaceid": "59952b1f-a979-435c-b62a-121d29086ca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:41:f5,bridge_name='br-int',has_traffic_filtering=True,id=59952b1f-a979-435c-b62a-121d29086ca8,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap59952b1f-a9') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:41:f5,bridge_name='br-int',has_traffic_filtering=True,id=59952b1f-a979-435c-b62a-121d29086ca8,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap59952b1f-a9') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59952b1f-a9, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: INFO os_vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:41:f5,bridge_name='br-int',has_traffic_filtering=True,id=59952b1f-a979-435c-b62a-121d29086ca8,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap59952b1f-a9')
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:08:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:08:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "303d5eaf-9f56-46f8-a525-38e786edba0f", "address": "fa:16:3e:60:b3:14", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303d5eaf-9f", "ovs_interfaceid": "303d5eaf-9f56-46f8-a525-38e786edba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "303d5eaf-9f56-46f8-a525-38e786edba0f", "address": "fa:16:3e:60:b3:14", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303d5eaf-9f", "ovs_interfaceid": "303d5eaf-9f56-46f8-a525-38e786edba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:b3:14,bridge_name='br-int',has_traffic_filtering=True,id=303d5eaf-9f56-46f8-a525-38e786edba0f,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap303d5eaf-9f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:b3:14,bridge_name='br-int',has_traffic_filtering=True,id=303d5eaf-9f56-46f8-a525-38e786edba0f,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap303d5eaf-9f') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap303d5eaf-9f, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: INFO os_vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:b3:14,bridge_name='br-int',has_traffic_filtering=True,id=303d5eaf-9f56-46f8-a525-38e786edba0f,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap303d5eaf-9f')
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:08:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:08:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eee5f90-639a-4724-9758-0689e4548963", "address": "fa:16:3e:7c:7a:10", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee5f90-63", "ovs_interfaceid": "2eee5f90-639a-4724-9758-0689e4548963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "2eee5f90-639a-4724-9758-0689e4548963", "address": "fa:16:3e:7c:7a:10", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee5f90-63", "ovs_interfaceid": "2eee5f90-639a-4724-9758-0689e4548963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:7a:10,bridge_name='br-int',has_traffic_filtering=True,id=2eee5f90-639a-4724-9758-0689e4548963,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eee5f90-63') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:7a:10,bridge_name='br-int',has_traffic_filtering=True,id=2eee5f90-639a-4724-9758-0689e4548963,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eee5f90-63') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eee5f90-63, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: INFO os_vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:7a:10,bridge_name='br-int',has_traffic_filtering=True,id=2eee5f90-639a-4724-9758-0689e4548963,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eee5f90-63')
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:08:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:08:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "address": "fa:16:3e:71:74:23", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6dbc98-d0", "ovs_interfaceid": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "address": "fa:16:3e:71:74:23", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6dbc98-d0", "ovs_interfaceid": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:74:23,bridge_name='br-int',has_traffic_filtering=True,id=7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f6dbc98-d0') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:74:23,bridge_name='br-int',has_traffic_filtering=True,id=7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f6dbc98-d0') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f6dbc98-d0, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: INFO os_vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:74:23,bridge_name='br-int',has_traffic_filtering=True,id=7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1,network=Network(ec94df5e-22eb-4548-9961-dbdb39a255ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f6dbc98-d0')
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:08:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:08:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "address": "fa:16:3e:7c:02:0f", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f11c7c-09", "ovs_interfaceid": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "address": "fa:16:3e:7c:02:0f", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f11c7c-09", "ovs_interfaceid": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:02:0f,bridge_name='br-int',has_traffic_filtering=True,id=40f11c7c-09cf-4b21-acb5-a6281b4421ec,network=Network(441fb7a1-13d3-443a-aabc-c441247f856d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f11c7c-09') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:02:0f,bridge_name='br-int',has_traffic_filtering=True,id=40f11c7c-09cf-4b21-acb5-a6281b4421ec,network=Network(441fb7a1-13d3-443a-aabc-c441247f856d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f11c7c-09') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40f11c7c-09, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: INFO os_vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:02:0f,bridge_name='br-int',has_traffic_filtering=True,id=40f11c7c-09cf-4b21-acb5-a6281b4421ec,network=Network(441fb7a1-13d3-443a-aabc-c441247f856d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f11c7c-09')
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1972375399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1972375399',id=19,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKNMYpLR/qHVSAJM2hhtWNWgLv0cN8UUmwpNTygUteCNcdj6No3jIS8yujDpt2sPkW1r+1pGaZsIophuXrRRlQsEWlnTT3GEAjFqCJery1lL9cqHhkTljFbMqs3L78uqw==',key_name='tempest-keypair-1153325355',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:08:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='949c208a6b7c45ff9469fd3b39b560bf',ramdisk_id='',reservation_id='r-0nlbc39t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1961372466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1961372466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:08:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3407a2faec4343109bf84e1e7337af07',uuid=3a5a9026-70f9-42fd-b8f8-66fc893ced35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "address": "fa:16:3e:dc:39:ca", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca21dc2-49", "ovs_interfaceid": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converting VIF {"id": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "address": "fa:16:3e:dc:39:ca", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca21dc2-49", "ovs_interfaceid": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:39:ca,bridge_name='br-int',has_traffic_filtering=True,id=4ca21dc2-4954-40eb-81b9-de0d4d91c08c,network=Network(441fb7a1-13d3-443a-aabc-c441247f856d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca21dc2-49') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:39:ca,bridge_name='br-int',has_traffic_filtering=True,id=4ca21dc2-4954-40eb-81b9-de0d4d91c08c,network=Network(441fb7a1-13d3-443a-aabc-c441247f856d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca21dc2-49') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ca21dc2-49, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:10:10 user nova-compute[71312]: INFO os_vif [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:39:ca,bridge_name='br-int',has_traffic_filtering=True,id=4ca21dc2-4954-40eb-81b9-de0d4d91c08c,network=Network(441fb7a1-13d3-443a-aabc-c441247f856d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca21dc2-49')
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvocUhpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:10:10 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aa7d6a-f32b-4689-9349-bf7d3828e8fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:10:10 user nova-compute[71312]: No targets found.
Jul 25 10:10:10 user nova-compute[71312]: iSNS:
Jul 25 10:10:10 user nova-compute[71312]: No targets found.
Jul 25 10:10:10 user nova-compute[71312]: STATIC:
Jul 25 10:10:10 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0
Jul 25 10:10:10 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:10 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:10 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:10:10 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:10 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:10 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f
Jul 25 10:10:10 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:10 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:10 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087
Jul 25 10:10:10 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:10 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:10 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e
Jul 25 10:10:10 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:10 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:10 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8
Jul 25 10:10:10 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:10 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:10 user nova-compute[71312]: FIRMWARE:
Jul 25 10:10:10 user nova-compute[71312]: No targets found.
Jul 25 10:10:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:10:10 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:10:10 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f335fc47-2dde-472d-94d6-f53c40095a63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[422b1d72-46c4-43b4-9635-96587a086f64]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:10:10 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:10:10 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:10:10 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:10:10 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:10:10 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:10:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:10:10 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 (non-flash)
Jul 25 10:10:10 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:10:10 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:10:10 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:10:10 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:10:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a85a5630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c51a14d-d6d4-49de-9ded-cdd0c3c0eab1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2822c1-f7b7-4536-bb23-93988ce34d09]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[176c45f1-78e1-4dcf-9312-41a8f3cf5589]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:10 user nova-compute[71312]: WARNING nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-99d7dcea-66cf-481f-9032-88bc7ca0f945 for instance with vm_state active and task_state deleting.
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-unplugged-303d5eaf-9f56-46f8-a525-38e786edba0f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-unplugged-303d5eaf-9f56-46f8-a525-38e786edba0f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-unplugged-303d5eaf-9f56-46f8-a525-38e786edba0f for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-303d5eaf-9f56-46f8-a525-38e786edba0f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-303d5eaf-9f56-46f8-a525-38e786edba0f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:10 user nova-compute[71312]: WARNING nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-303d5eaf-9f56-46f8-a525-38e786edba0f for instance with vm_state active and task_state deleting.
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-unplugged-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-unplugged-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-unplugged-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:10 user nova-compute[71312]: WARNING nova.compute.manager [req-30c10980-d0e4-4b60-976d-e9b314a79417 req-5143db18-d954-44d0-b9c0-10a28838bd30 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 for instance with vm_state active and task_state deleting.
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1c2624-e1ea-44c4-833b-36ec73098810]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b42ee1-be4e-4e85-a589-82404f1b8995]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aee3f9f-1f82-4efc-8868-1460bf46d8b5]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087, portal: 172.16.0.220,3260]
Jul 25 10:10:11 user nova-compute[71312]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087, portal: 172.16.0.220,3260] successful.
Jul 25 10:10:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307e9899-abfd-4370-a46e-da0f8d160087 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2859298-15f4-4a5d-92a8-04e0f8fb38ef]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] <== disconnect_volume: return (357ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgRaNEOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:10:11 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9af0f5-5b68-43ab-9a75-c92116832a34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:10:11 user nova-compute[71312]: No targets found.
Jul 25 10:10:11 user nova-compute[71312]: iSNS:
Jul 25 10:10:11 user nova-compute[71312]: No targets found.
Jul 25 10:10:11 user nova-compute[71312]: STATIC:
Jul 25 10:10:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0
Jul 25 10:10:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:10:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f
Jul 25 10:10:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e
Jul 25 10:10:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8
Jul 25 10:10:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:11 user nova-compute[71312]: FIRMWARE:
Jul 25 10:10:11 user nova-compute[71312]: No targets found.
Jul 25 10:10:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:10:11 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:10:11 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-59952b1f-a979-435c-b62a-121d29086ca8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-59952b1f-a979-435c-b62a-121d29086ca8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:11 user nova-compute[71312]: WARNING nova.compute.manager [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-59952b1f-a979-435c-b62a-121d29086ca8 for instance with vm_state active and task_state deleting.
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-unplugged-2eee5f90-639a-4724-9758-0689e4548963 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-unplugged-2eee5f90-639a-4724-9758-0689e4548963 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-unplugged-2eee5f90-639a-4724-9758-0689e4548963 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-2eee5f90-639a-4724-9758-0689e4548963 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-2eee5f90-639a-4724-9758-0689e4548963 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:11 user nova-compute[71312]: WARNING nova.compute.manager [req-db0382b7-ada2-40ba-9343-d6ef3d9bc124 req-a65d9bb1-e76b-4c6d-bf09-9ddbe45a0db4 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-2eee5f90-639a-4724-9758-0689e4548963 for instance with vm_state active and task_state deleting.
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ab9a68-5555-4a13-8f74-88fba713e36b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a86a132-da20-43f3-a1e9-53d2d6f30b62]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:10:11 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:10:11 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:10:11 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:10:11 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:10:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:10:11 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 (non-flash)
Jul 25 10:10:11 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:10:11 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:10:11 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:10:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a85a6c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8'): ({'sde'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Removing single pathed devices sde {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df9cf9f-9847-47d0-b315-d6bed5c35a4f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[12463a37-2889-4c7e-b78c-934e6c08b268]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Flushing IO for device /dev/sde {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[279f908d-5588-4d06-9cde-ffbf70ee66d1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41dd0a7-d0a3-4b2e-ba7e-d1bbb3ea1b8f]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f05167-41a9-43d5-aa25-b46ec43b5621]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee452c8-413b-4568-b010-7f718b6ff1a2]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8, portal: 172.16.0.220,3260]
Jul 25 10:10:11 user nova-compute[71312]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8, portal: 172.16.0.220,3260] successful.
Jul 25 10:10:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e66dab-75fe-4f24-9045-d554eac9ccd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[744e8c59-1524-4634-b14a-126277f92d39]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] <== disconnect_volume: return (340ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEkwLWsV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:10:11 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[749c0cfa-cf27-456d-9c6e-91e2b4a7bc15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:10:11 user nova-compute[71312]: No targets found.
Jul 25 10:10:11 user nova-compute[71312]: iSNS:
Jul 25 10:10:11 user nova-compute[71312]: No targets found.
Jul 25 10:10:11 user nova-compute[71312]: STATIC:
Jul 25 10:10:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0
Jul 25 10:10:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:10:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f
Jul 25 10:10:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e
Jul 25 10:10:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:11 user nova-compute[71312]: FIRMWARE:
Jul 25 10:10:11 user nova-compute[71312]: No targets found.
Jul 25 10:10:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:10:11 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:10:11 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c925a218-f354-4b1c-b161-a30e48fb0707]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[278c3a52-acd8-4b87-bda7-2472630a4bba]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:10:11 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:10:11 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:10:11 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:10:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:10:11 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 (non-flash)
Jul 25 10:10:11 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:10:11 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:10:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a85a6c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0'): ({'sdf'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Removing single pathed devices sdf {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7657f828-4c58-434e-8f79-971d81ced2a8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[45aee078-d5c3-46f9-adbb-f1ce50c4b118]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Flushing IO for device /dev/sdf {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d975d5b3-9040-43a5-8777-32a5e49fbb94]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b163f921-98a8-4d94-af57-6b8f82a6bfac]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4ed6e0-b939-4281-bc9f-cd6c0ea248cf]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-40f11c7c-09cf-4b21-acb5-a6281b4421ec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-40f11c7c-09cf-4b21-acb5-a6281b4421ec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:11 user nova-compute[71312]: WARNING nova.compute.manager [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-40f11c7c-09cf-4b21-acb5-a6281b4421ec for instance with vm_state active and task_state deleting.
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-unplugged-4ca21dc2-4954-40eb-81b9-de0d4d91c08c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-unplugged-4ca21dc2-4954-40eb-81b9-de0d4d91c08c {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-unplugged-4ca21dc2-4954-40eb-81b9-de0d4d91c08c for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-plugged-4ca21dc2-4954-40eb-81b9-de0d4d91c08c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] Acquiring lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] No waiting events found dispatching network-vif-plugged-4ca21dc2-4954-40eb-81b9-de0d4d91c08c {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:11 user nova-compute[71312]: WARNING nova.compute.manager [req-43158479-a6dc-468c-96c0-1d47ba162341 req-e677b940-de2e-4f49-96fd-7fc04e1c220b service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received unexpected event network-vif-plugged-4ca21dc2-4954-40eb-81b9-de0d4d91c08c for instance with vm_state active and task_state deleting.
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eb3b7d-41bb-42e7-9718-34a0aba75ddb]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0, portal: 172.16.0.220,3260]
Jul 25 10:10:11 user nova-compute[71312]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0, portal: 172.16.0.220,3260] successful.
Jul 25 10:10:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e3facd7-a2a8-4d1f-80b8-b3cbda0b78e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1b5627-bd2e-4f73-b904-a70d539c35c8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] <== disconnect_volume: return (314ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:10:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Deleting instance files /opt/stack/data/nova/instances/3a5a9026-70f9-42fd-b8f8-66fc893ced35_del
Jul 25 10:10:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Deletion of /opt/stack/data/nova/instances/3a5a9026-70f9-42fd-b8f8-66fc893ced35_del complete
Jul 25 10:10:11 user nova-compute[71312]: INFO nova.compute.manager [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Took 3.32 seconds to destroy the instance on the hypervisor.
Jul 25 10:10:11 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:10:11 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:10:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-0c9ad0a5-8603-44ca-a84f-46bc16eec4cb req-949014eb-49b2-46bd-812d-b55685ee8035 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-deleted-99d7dcea-66cf-481f-9032-88bc7ca0f945 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:14 user nova-compute[71312]: INFO nova.compute.manager [req-0c9ad0a5-8603-44ca-a84f-46bc16eec4cb req-949014eb-49b2-46bd-812d-b55685ee8035 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Neutron deleted interface 99d7dcea-66cf-481f-9032-88bc7ca0f945; detaching it from the instance and deleting it from the info cache
Jul 25 10:10:14 user nova-compute[71312]: DEBUG nova.network.neutron [req-0c9ad0a5-8603-44ca-a84f-46bc16eec4cb req-949014eb-49b2-46bd-812d-b55685ee8035 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updating instance_info_cache with network_info: [{"id": "59952b1f-a979-435c-b62a-121d29086ca8", "address": "fa:16:3e:50:41:f5", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59952b1f-a9", "ovs_interfaceid": "59952b1f-a979-435c-b62a-121d29086ca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "303d5eaf-9f56-46f8-a525-38e786edba0f", "address": "fa:16:3e:60:b3:14", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303d5eaf-9f", "ovs_interfaceid": "303d5eaf-9f56-46f8-a525-38e786edba0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eee5f90-639a-4724-9758-0689e4548963", "address": "fa:16:3e:7c:7a:10", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eee5f90-63", "ovs_interfaceid": "2eee5f90-639a-4724-9758-0689e4548963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "address": "fa:16:3e:71:74:23", "network": {"id": "ec94df5e-22eb-4548-9961-dbdb39a255ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-850870408", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f6dbc98-d0", "ovs_interfaceid": "7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "address": "fa:16:3e:7c:02:0f", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f11c7c-09", "ovs_interfaceid": "40f11c7c-09cf-4b21-acb5-a6281b4421ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "address": "fa:16:3e:dc:39:ca", "network": {"id": "441fb7a1-13d3-443a-aabc-c441247f856d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1852998367", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "949c208a6b7c45ff9469fd3b39b560bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca21dc2-49", "ovs_interfaceid": "4ca21dc2-4954-40eb-81b9-de0d4d91c08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:10:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-0c9ad0a5-8603-44ca-a84f-46bc16eec4cb req-949014eb-49b2-46bd-812d-b55685ee8035 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Detach interface failed, port_id=99d7dcea-66cf-481f-9032-88bc7ca0f945, reason: Instance 3a5a9026-70f9-42fd-b8f8-66fc893ced35 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:10:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:15 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:10:15 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Took 3.98 seconds to deallocate network for instance.
Jul 25 10:10:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-2baaa834-4209-4fe5-96be-1156d793cf2f req-5896ceb2-ea82-4bc7-bce2-f1c4be2ea925 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-deleted-7f6dbc98-d0a0-4ae5-8cf2-dd0794786ab1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-2baaa834-4209-4fe5-96be-1156d793cf2f req-5896ceb2-ea82-4bc7-bce2-f1c4be2ea925 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-deleted-2eee5f90-639a-4724-9758-0689e4548963 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-2baaa834-4209-4fe5-96be-1156d793cf2f req-5896ceb2-ea82-4bc7-bce2-f1c4be2ea925 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-deleted-40f11c7c-09cf-4b21-acb5-a6281b4421ec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-2baaa834-4209-4fe5-96be-1156d793cf2f req-5896ceb2-ea82-4bc7-bce2-f1c4be2ea925 service nova] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Received event network-vif-deleted-4ca21dc2-4954-40eb-81b9-de0d4d91c08c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:18 user nova-compute[71312]: INFO nova.compute.manager [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Took 2.36 seconds to detach 3 volumes for instance.
Jul 25 10:10:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:18 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279803.4519672, a35abe6a-0a8b-4eb2-8781-85b99539d1fc => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:10:18 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] VM Stopped (Lifecycle Event)
Jul 25 10:10:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-babe2015-c0d3-495c-98ee-9c29d72a6342 None None] [instance: a35abe6a-0a8b-4eb2-8781-85b99539d1fc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:10:18 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:10:18 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:10:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:18 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Deleted allocations for instance 3a5a9026-70f9-42fd-b8f8-66fc893ced35
Jul 25 10:10:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3eaad8d-e7c0-4ab6-9c4f-5bf70ab5d3f8 tempest-TaggedBootDevicesTest_v242-1961372466 tempest-TaggedBootDevicesTest_v242-1961372466-project-member] Lock "3a5a9026-70f9-42fd-b8f8-66fc893ced35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.216s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:19 user nova-compute[71312]: INFO nova.compute.manager [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Terminating instance
Jul 25 10:10:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:10:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-bf3dad63-130b-4090-9e0e-9b4653531472 req-dcf4868f-c4b9-48cb-adeb-1c6b19513676 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Received event network-vif-unplugged-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bf3dad63-130b-4090-9e0e-9b4653531472 req-dcf4868f-c4b9-48cb-adeb-1c6b19513676 service nova] Acquiring lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bf3dad63-130b-4090-9e0e-9b4653531472 req-dcf4868f-c4b9-48cb-adeb-1c6b19513676 service nova] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bf3dad63-130b-4090-9e0e-9b4653531472 req-dcf4868f-c4b9-48cb-adeb-1c6b19513676 service nova] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-bf3dad63-130b-4090-9e0e-9b4653531472 req-dcf4868f-c4b9-48cb-adeb-1c6b19513676 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] No waiting events found dispatching network-vif-unplugged-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-bf3dad63-130b-4090-9e0e-9b4653531472 req-dcf4868f-c4b9-48cb-adeb-1c6b19513676 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Received event network-vif-unplugged-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:10:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Instance destroyed successfully.
Jul 25 10:10:20 user nova-compute[71312]: DEBUG nova.objects.instance [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'resources' on Instance uuid 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-16019691',display_name='tempest-AttachVolumeNegativeTest-server-16019691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-16019691',id=18,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa6BmX0sZgnnMKJlSNiZSVVUE1EbjKrVljO/6/wJp7DA6VB00mN9ek8Qwhz2H0nQNPaiF2Iz0nysXLx8PC5l5aZ9mPwNu5Pg35qsmp2kzw+NPUHtAaZRii2xvKN+h95/w==',key_name='tempest-keypair-863741174',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:07:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a09fcc394c945c2b843abf3df53cda6',ramdisk_id='',reservation_id='r-uhavf33z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1016049404',owner_user_name='tempest-AttachVolumeNegativeTest-1016049404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:07:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe1a69013de4b4dbcb98a35e48d8ee8',uuid=0a221b2c-60d5-4751-84c1-0f4bfbc3f303,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "address": "fa:16:3e:dd:c9:ee", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504a0f5e-a1", "ovs_interfaceid": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converting VIF {"id": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "address": "fa:16:3e:dd:c9:ee", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504a0f5e-a1", "ovs_interfaceid": "504a0f5e-a1d1-4925-94a1-f1a775fa3e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c9:ee,bridge_name='br-int',has_traffic_filtering=True,id=504a0f5e-a1d1-4925-94a1-f1a775fa3e1e,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504a0f5e-a1') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG os_vif [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c9:ee,bridge_name='br-int',has_traffic_filtering=True,id=504a0f5e-a1d1-4925-94a1-f1a775fa3e1e,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504a0f5e-a1') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap504a0f5e-a1, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:20 user nova-compute[71312]: INFO os_vif [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c9:ee,bridge_name='br-int',has_traffic_filtering=True,id=504a0f5e-a1d1-4925-94a1-f1a775fa3e1e,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504a0f5e-a1')
Jul 25 10:10:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Deleting instance files /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303_del
Jul 25 10:10:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Deletion of /opt/stack/data/nova/instances/0a221b2c-60d5-4751-84c1-0f4bfbc3f303_del complete
Jul 25 10:10:20 user nova-compute[71312]: INFO nova.compute.manager [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 25 10:10:20 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:10:20 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:10:21 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:10:21 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Took 0.98 seconds to deallocate network for instance.
Jul 25 10:10:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:21 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:10:21 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:10:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:22 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Deleted allocations for instance 0a221b2c-60d5-4751-84c1-0f4bfbc3f303
Jul 25 10:10:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-53e48439-612a-4e3c-91c3-4c17c8f80950 req-444718c6-5275-4242-8cd9-57d8bc7b2006 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Received event network-vif-plugged-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-53e48439-612a-4e3c-91c3-4c17c8f80950 req-444718c6-5275-4242-8cd9-57d8bc7b2006 service nova] Acquiring lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-53e48439-612a-4e3c-91c3-4c17c8f80950 req-444718c6-5275-4242-8cd9-57d8bc7b2006 service nova] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-53e48439-612a-4e3c-91c3-4c17c8f80950 req-444718c6-5275-4242-8cd9-57d8bc7b2006 service nova] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-53e48439-612a-4e3c-91c3-4c17c8f80950 req-444718c6-5275-4242-8cd9-57d8bc7b2006 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] No waiting events found dispatching network-vif-plugged-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:22 user nova-compute[71312]: WARNING nova.compute.manager [req-53e48439-612a-4e3c-91c3-4c17c8f80950 req-444718c6-5275-4242-8cd9-57d8bc7b2006 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Received unexpected event network-vif-plugged-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e for instance with vm_state deleted and task_state None.
Jul 25 10:10:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-53e48439-612a-4e3c-91c3-4c17c8f80950 req-444718c6-5275-4242-8cd9-57d8bc7b2006 service nova] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Received event network-vif-deleted-504a0f5e-a1d1-4925-94a1-f1a775fa3e1e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fdddfe9f-36da-4f6f-9725-6dbe7698abf5 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "0a221b2c-60d5-4751-84c1-0f4bfbc3f303" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.411s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "80e8cdf1-c86a-43aa-a66c-46af281187a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:10:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:10:24 user nova-compute[71312]: INFO nova.compute.claims [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Claim successful on node user
Jul 25 10:10:24 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:10:24 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG nova.network.neutron [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:10:25 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:10:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG nova.policy [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9b48294a6374f439d94cb121c01dca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa44925fd09496683b46b15f728e9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:10:25 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Creating image(s)
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "/opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "/opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "/opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279810.3384802, 3a5a9026-70f9-42fd-b8f8-66fc893ced35 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:10:25 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] VM Stopped (Lifecycle Event)
Jul 25 10:10:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-02b49b5d-029d-4af1-8a03-2cdb16f1e3e9 None None] [instance: 3a5a9026-70f9-42fd-b8f8-66fc893ced35] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.255s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk 1073741824" returned: 0 in 0.056s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.172s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:10:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Successfully created port: 8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:10:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:26 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Cannot resize image /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:10:26 user nova-compute[71312]: DEBUG nova.objects.instance [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lazy-loading 'migration_context' on Instance uuid 80e8cdf1-c86a-43aa-a66c-46af281187a5 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:10:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:10:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Ensure instance console log exists: /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:10:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Successfully updated port: 8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "refresh_cache-80e8cdf1-c86a-43aa-a66c-46af281187a5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquired lock "refresh_cache-80e8cdf1-c86a-43aa-a66c-46af281187a5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8f09918-c7fd-4a52-84d0-2220c4fb8540 req-35a6f4da-5590-49b5-8430-5d7da2a323a4 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received event network-changed-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8f09918-c7fd-4a52-84d0-2220c4fb8540 req-35a6f4da-5590-49b5-8430-5d7da2a323a4 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Refreshing instance network info cache due to event network-changed-8ff58b4d-cb02-4ba7-861d-086db41f3083. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8f09918-c7fd-4a52-84d0-2220c4fb8540 req-35a6f4da-5590-49b5-8430-5d7da2a323a4 service nova] Acquiring lock "refresh_cache-80e8cdf1-c86a-43aa-a66c-46af281187a5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Updating instance_info_cache with network_info: [{"id": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "address": "fa:16:3e:5c:c5:1c", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff58b4d-cb", "ovs_interfaceid": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Releasing lock "refresh_cache-80e8cdf1-c86a-43aa-a66c-46af281187a5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Instance network_info: |[{"id": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "address": "fa:16:3e:5c:c5:1c", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff58b4d-cb", "ovs_interfaceid": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8f09918-c7fd-4a52-84d0-2220c4fb8540 req-35a6f4da-5590-49b5-8430-5d7da2a323a4 service nova] Acquired lock "refresh_cache-80e8cdf1-c86a-43aa-a66c-46af281187a5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-b8f09918-c7fd-4a52-84d0-2220c4fb8540 req-35a6f4da-5590-49b5-8430-5d7da2a323a4 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Refreshing network info cache for port 8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Start _get_guest_xml network_info=[{"id": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "address": "fa:16:3e:5c:c5:1c", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff58b4d-cb", "ovs_interfaceid": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:10:27 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:10:27 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-106862461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-106862461',id=23,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdQM82Qejh+nCjNUoCEwa+DKMm0p2VFnjpf/T0PHj6mKTHaG9P7+dSiT5CBJYIEOhDFNdBvLGEX+Bgxld753JvW1e2toucYORGNEtErTZHvvfOcNDV6OOHiFOV59zZ0tA==',key_name='tempest-keypair-593905888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8aa44925fd09496683b46b15f728e9ca',ramdisk_id='',reservation_id='r-nteiea17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1599012039',owner_user_name='tempest-ServerActionsV293TestJSON-1599012039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9b48294a6374f439d94cb121c01dca9',uuid=80e8cdf1-c86a-43aa-a66c-46af281187a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "address": "fa:16:3e:5c:c5:1c", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff58b4d-cb", "ovs_interfaceid": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converting VIF {"id": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "address": "fa:16:3e:5c:c5:1c", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff58b4d-cb", "ovs_interfaceid": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:c5:1c,bridge_name='br-int',has_traffic_filtering=True,id=8ff58b4d-cb02-4ba7-861d-086db41f3083,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff58b4d-cb') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.objects.instance [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lazy-loading 'pci_devices' on Instance uuid 80e8cdf1-c86a-43aa-a66c-46af281187a5 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Updating instance_info_cache with network_info: [{"id": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "address": "fa:16:3e:60:b3:44", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d07c46c-fb", "ovs_interfaceid": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:10:27 user nova-compute[71312]:   <uuid>80e8cdf1-c86a-43aa-a66c-46af281187a5</uuid>
Jul 25 10:10:27 user nova-compute[71312]:   <name>instance-00000017</name>
Jul 25 10:10:27 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:10:27 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:10:27 user nova-compute[71312]:   <metadata>
Jul 25 10:10:27 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:10:27 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:10:27 user nova-compute[71312]:       <nova:name>tempest-ServerActionsV293TestJSON-server-106862461</nova:name>
Jul 25 10:10:27 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:10:27</nova:creationTime>
Jul 25 10:10:27 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:10:27 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:10:27 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:10:27 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:10:27 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:10:27 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:10:27 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:10:27 user nova-compute[71312]:       <nova:owner>
Jul 25 10:10:27 user nova-compute[71312]:         <nova:user uuid="c9b48294a6374f439d94cb121c01dca9">tempest-ServerActionsV293TestJSON-1599012039-project-member</nova:user>
Jul 25 10:10:27 user nova-compute[71312]:         <nova:project uuid="8aa44925fd09496683b46b15f728e9ca">tempest-ServerActionsV293TestJSON-1599012039</nova:project>
Jul 25 10:10:27 user nova-compute[71312]:       </nova:owner>
Jul 25 10:10:27 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:10:27 user nova-compute[71312]:       <nova:ports>
Jul 25 10:10:27 user nova-compute[71312]:         <nova:port uuid="8ff58b4d-cb02-4ba7-861d-086db41f3083">
Jul 25 10:10:27 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 10:10:27 user nova-compute[71312]:         </nova:port>
Jul 25 10:10:27 user nova-compute[71312]:       </nova:ports>
Jul 25 10:10:27 user nova-compute[71312]:     </nova:instance>
Jul 25 10:10:27 user nova-compute[71312]:   </metadata>
Jul 25 10:10:27 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:10:27 user nova-compute[71312]:     <system>
Jul 25 10:10:27 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:10:27 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:10:27 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:10:27 user nova-compute[71312]:       <entry name="serial">80e8cdf1-c86a-43aa-a66c-46af281187a5</entry>
Jul 25 10:10:27 user nova-compute[71312]:       <entry name="uuid">80e8cdf1-c86a-43aa-a66c-46af281187a5</entry>
Jul 25 10:10:27 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:10:27 user nova-compute[71312]:     </system>
Jul 25 10:10:27 user nova-compute[71312]:   </sysinfo>
Jul 25 10:10:27 user nova-compute[71312]:   <os>
Jul 25 10:10:27 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:10:27 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:10:27 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:10:27 user nova-compute[71312]:   </os>
Jul 25 10:10:27 user nova-compute[71312]:   <features>
Jul 25 10:10:27 user nova-compute[71312]:     <acpi/>
Jul 25 10:10:27 user nova-compute[71312]:     <apic/>
Jul 25 10:10:27 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:10:27 user nova-compute[71312]:   </features>
Jul 25 10:10:27 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:10:27 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:10:27 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:10:27 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:10:27 user nova-compute[71312]:   </clock>
Jul 25 10:10:27 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:10:27 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:10:27 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:10:27 user nova-compute[71312]:   </cpu>
Jul 25 10:10:27 user nova-compute[71312]:   <devices>
Jul 25 10:10:27 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:10:27 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:10:27 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk"/>
Jul 25 10:10:27 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:10:27 user nova-compute[71312]:     </disk>
Jul 25 10:10:27 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:10:27 user nova-compute[71312]:       <mac address="fa:16:3e:5c:c5:1c"/>
Jul 25 10:10:27 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:10:27 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:10:27 user nova-compute[71312]:       <target dev="tap8ff58b4d-cb"/>
Jul 25 10:10:27 user nova-compute[71312]:     </interface>
Jul 25 10:10:27 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:10:27 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/console.log" append="off"/>
Jul 25 10:10:27 user nova-compute[71312]:     </serial>
Jul 25 10:10:27 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:10:27 user nova-compute[71312]:     <video>
Jul 25 10:10:27 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:10:27 user nova-compute[71312]:     </video>
Jul 25 10:10:27 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:10:27 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:10:27 user nova-compute[71312]:     </rng>
Jul 25 10:10:27 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:10:27 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:10:27 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:10:27 user nova-compute[71312]:     </memballoon>
Jul 25 10:10:27 user nova-compute[71312]:   </devices>
Jul 25 10:10:27 user nova-compute[71312]: </domain>
Jul 25 10:10:27 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-106862461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-106862461',id=23,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdQM82Qejh+nCjNUoCEwa+DKMm0p2VFnjpf/T0PHj6mKTHaG9P7+dSiT5CBJYIEOhDFNdBvLGEX+Bgxld753JvW1e2toucYORGNEtErTZHvvfOcNDV6OOHiFOV59zZ0tA==',key_name='tempest-keypair-593905888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8aa44925fd09496683b46b15f728e9ca',ramdisk_id='',reservation_id='r-nteiea17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1599012039',owner_user_name='tempest-ServerActionsV293TestJSON-1599012039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9b48294a6374f439d94cb121c01dca9',uuid=80e8cdf1-c86a-43aa-a66c-46af281187a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "address": "fa:16:3e:5c:c5:1c", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff58b4d-cb", "ovs_interfaceid": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converting VIF {"id": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "address": "fa:16:3e:5c:c5:1c", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff58b4d-cb", "ovs_interfaceid": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:c5:1c,bridge_name='br-int',has_traffic_filtering=True,id=8ff58b4d-cb02-4ba7-861d-086db41f3083,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff58b4d-cb') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG os_vif [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:c5:1c,bridge_name='br-int',has_traffic_filtering=True,id=8ff58b4d-cb02-4ba7-861d-086db41f3083,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff58b4d-cb') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ff58b4d-cb, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ff58b4d-cb, col_values=(('external_ids', {'iface-id': '8ff58b4d-cb02-4ba7-861d-086db41f3083', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:c5:1c', 'vm-uuid': '80e8cdf1-c86a-43aa-a66c-46af281187a5'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:27 user nova-compute[71312]: INFO os_vif [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:c5:1c,bridge_name='br-int',has_traffic_filtering=True,id=8ff58b4d-cb02-4ba7-861d-086db41f3083,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff58b4d-cb')
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:10:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] No VIF found with MAC fa:16:3e:5c:c5:1c, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:10:28 user nova-compute[71312]: DEBUG nova.network.neutron [req-b8f09918-c7fd-4a52-84d0-2220c4fb8540 req-35a6f4da-5590-49b5-8430-5d7da2a323a4 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Updated VIF entry in instance network info cache for port 8ff58b4d-cb02-4ba7-861d-086db41f3083. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:10:28 user nova-compute[71312]: DEBUG nova.network.neutron [req-b8f09918-c7fd-4a52-84d0-2220c4fb8540 req-35a6f4da-5590-49b5-8430-5d7da2a323a4 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Updating instance_info_cache with network_info: [{"id": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "address": "fa:16:3e:5c:c5:1c", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff58b4d-cb", "ovs_interfaceid": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:10:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8f09918-c7fd-4a52-84d0-2220c4fb8540 req-35a6f4da-5590-49b5-8430-5d7da2a323a4 service nova] Releasing lock "refresh_cache-80e8cdf1-c86a-43aa-a66c-46af281187a5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-4c3af463-ca02-4531-9513-441c1b188762 req-4a9cc7ff-0be3-4f36-9052-eec8df3f178d service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received event network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4c3af463-ca02-4531-9513-441c1b188762 req-4a9cc7ff-0be3-4f36-9052-eec8df3f178d service nova] Acquiring lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4c3af463-ca02-4531-9513-441c1b188762 req-4a9cc7ff-0be3-4f36-9052-eec8df3f178d service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4c3af463-ca02-4531-9513-441c1b188762 req-4a9cc7ff-0be3-4f36-9052-eec8df3f178d service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-4c3af463-ca02-4531-9513-441c1b188762 req-4a9cc7ff-0be3-4f36-9052-eec8df3f178d service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] No waiting events found dispatching network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:29 user nova-compute[71312]: WARNING nova.compute.manager [req-4c3af463-ca02-4531-9513-441c1b188762 req-4a9cc7ff-0be3-4f36-9052-eec8df3f178d service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received unexpected event network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 for instance with vm_state building and task_state spawning.
Jul 25 10:10:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279831.2933996, 80e8cdf1-c86a-43aa-a66c-46af281187a5 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:10:31 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] VM Resumed (Lifecycle Event)
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:10:31 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Instance spawned successfully.
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:31 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279831.2981834, 80e8cdf1-c86a-43aa-a66c-46af281187a5 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:10:31 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] VM Started (Lifecycle Event)
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:10:31 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-5d2b9fbb-6305-4271-8fd0-dc63c5785842 req-b816d38e-7cbc-4427-a0b7-90a80fa885cb service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received event network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5d2b9fbb-6305-4271-8fd0-dc63c5785842 req-b816d38e-7cbc-4427-a0b7-90a80fa885cb service nova] Acquiring lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5d2b9fbb-6305-4271-8fd0-dc63c5785842 req-b816d38e-7cbc-4427-a0b7-90a80fa885cb service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5d2b9fbb-6305-4271-8fd0-dc63c5785842 req-b816d38e-7cbc-4427-a0b7-90a80fa885cb service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-5d2b9fbb-6305-4271-8fd0-dc63c5785842 req-b816d38e-7cbc-4427-a0b7-90a80fa885cb service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] No waiting events found dispatching network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:10:31 user nova-compute[71312]: WARNING nova.compute.manager [req-5d2b9fbb-6305-4271-8fd0-dc63c5785842 req-b816d38e-7cbc-4427-a0b7-90a80fa885cb service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received unexpected event network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 for instance with vm_state building and task_state spawning.
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:10:31 user nova-compute[71312]: INFO nova.compute.manager [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Took 6.30 seconds to spawn the instance on the hypervisor.
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:31 user nova-compute[71312]: INFO nova.compute.manager [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Took 7.11 seconds to build instance.
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acea9688-bfb0-40ac-8b2d-ac4d59942b83 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.232s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:10:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:10:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7543MB free_disk=25.357036590576172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9be175c2-20a4-45ce-85a7-ee3c406a4b1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 2e01c123-09c0-4a29-abf0-727f61484747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance e47e9004-c0fb-45a4-8f65-78f1685e5105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance cba49a3e-0ffe-4ea2-a956-bb41c178dd38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 80e8cdf1-c86a-43aa-a66c-46af281187a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:35 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279820.537298, 0a221b2c-60d5-4751-84c1-0f4bfbc3f303 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:10:35 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] VM Stopped (Lifecycle Event)
Jul 25 10:10:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bc765480-2eb1-4c24-839a-2eb918004d3b None None] [instance: 0a221b2c-60d5-4751-84c1-0f4bfbc3f303] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:10:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:54 user nova-compute[71312]: INFO nova.compute.manager [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Detaching volume 50dff2d6-78b1-43e1-a3ab-f729dae8730f
Jul 25 10:10:54 user nova-compute[71312]: INFO nova.virt.block_device [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Attempting to driver detach volume 50dff2d6-78b1-43e1-a3ab-f729dae8730f from mountpoint /dev/vdc
Jul 25 10:10:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Attempting to detach device vdc from instance 9be175c2-20a4-45ce-85a7-ee3c406a4b1f from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:10:54 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:10:54 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Jul 25 10:10:54 user nova-compute[71312]:   <target dev="vdc" bus="virtio"/>
Jul 25 10:10:54 user nova-compute[71312]:   <serial>50dff2d6-78b1-43e1-a3ab-f729dae8730f</serial>
Jul 25 10:10:54 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 10:10:54 user nova-compute[71312]: </disk>
Jul 25 10:10:54 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:10:54 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Successfully detached device vdc from instance 9be175c2-20a4-45ce-85a7-ee3c406a4b1f from the persistent domain config.
Jul 25 10:10:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9be175c2-20a4-45ce-85a7-ee3c406a4b1f from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:10:54 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:10:54 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Jul 25 10:10:54 user nova-compute[71312]:   <target dev="vdc" bus="virtio"/>
Jul 25 10:10:54 user nova-compute[71312]:   <serial>50dff2d6-78b1-43e1-a3ab-f729dae8730f</serial>
Jul 25 10:10:54 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 10:10:54 user nova-compute[71312]: </disk>
Jul 25 10:10:54 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279854.5799637, 9be175c2-20a4-45ce-85a7-ee3c406a4b1f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9be175c2-20a4-45ce-85a7-ee3c406a4b1f {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:10:54 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Successfully detached device vdc from instance 9be175c2-20a4-45ce-85a7-ee3c406a4b1f from the live domain config.
Jul 25 10:10:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bmAoNUxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:10:54 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[234793e1-0955-4d66-8dd8-362859b17051]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:10:54 user nova-compute[71312]: No targets found.
Jul 25 10:10:54 user nova-compute[71312]: iSNS:
Jul 25 10:10:54 user nova-compute[71312]: No targets found.
Jul 25 10:10:54 user nova-compute[71312]: STATIC:
Jul 25 10:10:54 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:10:54 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:54 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:54 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f
Jul 25 10:10:54 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:54 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:54 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e
Jul 25 10:10:54 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:10:54 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:10:54 user nova-compute[71312]: FIRMWARE:
Jul 25 10:10:54 user nova-compute[71312]: No targets found.
Jul 25 10:10:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:10:54 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:10:54 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9e9544-1a97-4b85-b95a-cde3c7ee4f46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b992ac-107f-48e5-8234-7531254ef1f2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:10:54 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:10:54 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:10:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:10:54 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f (non-flash)
Jul 25 10:10:54 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:10:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a8623eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02f2100-aff9-4a08-b520-5eb16985f284]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15cd214-7edd-4188-ac15-89c5d77cad7d]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e216e3-e943-4529-8eff-3449b843b520]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6bce31-fc8b-4bb3-b9c7-1e00ac674039]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a3f11c-405e-4fa4-8592-7c9862a6076a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --logout" returned: 0 in 0.104s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1de9d4-1aae-4c84-aa5a-7035a1dd83a7]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f, portal: 172.16.0.220,3260]
Jul 25 10:10:54 user nova-compute[71312]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f, portal: 172.16.0.220,3260] successful.
Jul 25 10:10:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dff2d6-78b1-43e1-a3ab-f729dae8730f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd797d60-9ef7-4e70-bd2d-b891beedbdc1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] <== disconnect_volume: return (395ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:10:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:10:55 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'flavor' on Instance uuid 9be175c2-20a4-45ce-85a7-ee3c406a4b1f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:10:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6bc6b80b-7941-4365-afce-6fb62a76471c tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.758s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:10:56 user nova-compute[71312]: INFO nova.compute.manager [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] instance snapshotting
Jul 25 10:10:56 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Beginning live snapshot process
Jul 25 10:10:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json -f qcow2" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "3d7de169-d5d4-4dc6-9980-ce586554323c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:10:57 user nova-compute[71312]: INFO nova.compute.claims [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Claim successful on node user
Jul 25 10:10:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl4vyzngo/cdafe04f7fb6411e94336e821d214219.delta 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl4vyzngo/cdafe04f7fb6411e94336e821d214219.delta 1073741824" returned: 0 in 0.048s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:57 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 25 10:10:57 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:10:57 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:10:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG nova.policy [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c48272d2a58644b2b8b6a9c42b51c746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cb9228183844d5853c6c2a35f2658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:10:57 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Creating image(s)
Jul 25 10:10:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "/opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "/opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk 1073741824" returned: 0 in 0.065s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:10:58 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Cannot resize image /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG nova.objects.instance [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'migration_context' on Instance uuid 3d7de169-d5d4-4dc6-9980-ce586554323c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Ensure instance console log exists: /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:10:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl4vyzngo/cdafe04f7fb6411e94336e821d214219.delta /opt/stack/data/nova/instances/snapshots/tmpl4vyzngo/cdafe04f7fb6411e94336e821d214219 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:10:59 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Successfully created port: 8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:10:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl4vyzngo/cdafe04f7fb6411e94336e821d214219.delta /opt/stack/data/nova/instances/snapshots/tmpl4vyzngo/cdafe04f7fb6411e94336e821d214219" returned: 0 in 0.889s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:10:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Snapshot extracted, beginning image upload
Jul 25 10:10:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:10:59 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Successfully updated port: 8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:10:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "refresh_cache-3d7de169-d5d4-4dc6-9980-ce586554323c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:10:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquired lock "refresh_cache-3d7de169-d5d4-4dc6-9980-ce586554323c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:10:59 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-073d8e4a-0591-46df-a491-421b9ed0beb8 req-5d42e3de-7572-48a0-8409-f14dc92a1687 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Received event network-changed-8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-073d8e4a-0591-46df-a491-421b9ed0beb8 req-5d42e3de-7572-48a0-8409-f14dc92a1687 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Refreshing instance network info cache due to event network-changed-8142a6be-137e-4810-83f1-670d40336235. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-073d8e4a-0591-46df-a491-421b9ed0beb8 req-5d42e3de-7572-48a0-8409-f14dc92a1687 service nova] Acquiring lock "refresh_cache-3d7de169-d5d4-4dc6-9980-ce586554323c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Updating instance_info_cache with network_info: [{"id": "8142a6be-137e-4810-83f1-670d40336235", "address": "fa:16:3e:a2:38:4d", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8142a6be-13", "ovs_interfaceid": "8142a6be-137e-4810-83f1-670d40336235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Releasing lock "refresh_cache-3d7de169-d5d4-4dc6-9980-ce586554323c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Instance network_info: |[{"id": "8142a6be-137e-4810-83f1-670d40336235", "address": "fa:16:3e:a2:38:4d", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8142a6be-13", "ovs_interfaceid": "8142a6be-137e-4810-83f1-670d40336235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-073d8e4a-0591-46df-a491-421b9ed0beb8 req-5d42e3de-7572-48a0-8409-f14dc92a1687 service nova] Acquired lock "refresh_cache-3d7de169-d5d4-4dc6-9980-ce586554323c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.network.neutron [req-073d8e4a-0591-46df-a491-421b9ed0beb8 req-5d42e3de-7572-48a0-8409-f14dc92a1687 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Refreshing network info cache for port 8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Start _get_guest_xml network_info=[{"id": "8142a6be-137e-4810-83f1-670d40336235", "address": "fa:16:3e:a2:38:4d", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8142a6be-13", "ovs_interfaceid": "8142a6be-137e-4810-83f1-670d40336235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:11:00 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:11:00 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1731897971',display_name='tempest-AttachVolumeTestJSON-server-1731897971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1731897971',id=24,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP76U8pOmQj0T6UoWSIE8MwYl2QViBDvJlo+6VIrFrd7xplbfhajk4osrb3h0o5ol89Nr8I1EP7YXP/3x5K5kTv1MomBI4WO3sMBcDllyxK4gqCJXNgaWE4MYBg1SFtLiQ==',key_name='tempest-keypair-689919311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68cb9228183844d5853c6c2a35f2658f',ramdisk_id='',reservation_id='r-vgzgne07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1095711794',owner_user_name='tempest-AttachVolumeTestJSON-1095711794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48272d2a58644b2b8b6a9c42b51c746',uuid=3d7de169-d5d4-4dc6-9980-ce586554323c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8142a6be-137e-4810-83f1-670d40336235", "address": "fa:16:3e:a2:38:4d", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8142a6be-13", "ovs_interfaceid": "8142a6be-137e-4810-83f1-670d40336235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converting VIF {"id": "8142a6be-137e-4810-83f1-670d40336235", "address": "fa:16:3e:a2:38:4d", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8142a6be-13", "ovs_interfaceid": "8142a6be-137e-4810-83f1-670d40336235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:38:4d,bridge_name='br-int',has_traffic_filtering=True,id=8142a6be-137e-4810-83f1-670d40336235,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8142a6be-13') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d7de169-d5d4-4dc6-9980-ce586554323c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:11:00 user nova-compute[71312]:   <uuid>3d7de169-d5d4-4dc6-9980-ce586554323c</uuid>
Jul 25 10:11:00 user nova-compute[71312]:   <name>instance-00000018</name>
Jul 25 10:11:00 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:11:00 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:11:00 user nova-compute[71312]:   <metadata>
Jul 25 10:11:00 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:11:00 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:11:00 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeTestJSON-server-1731897971</nova:name>
Jul 25 10:11:00 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:11:00</nova:creationTime>
Jul 25 10:11:00 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:11:00 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:11:00 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:11:00 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:11:00 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:11:00 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:11:00 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:11:00 user nova-compute[71312]:       <nova:owner>
Jul 25 10:11:00 user nova-compute[71312]:         <nova:user uuid="c48272d2a58644b2b8b6a9c42b51c746">tempest-AttachVolumeTestJSON-1095711794-project-member</nova:user>
Jul 25 10:11:00 user nova-compute[71312]:         <nova:project uuid="68cb9228183844d5853c6c2a35f2658f">tempest-AttachVolumeTestJSON-1095711794</nova:project>
Jul 25 10:11:00 user nova-compute[71312]:       </nova:owner>
Jul 25 10:11:00 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:11:00 user nova-compute[71312]:       <nova:ports>
Jul 25 10:11:00 user nova-compute[71312]:         <nova:port uuid="8142a6be-137e-4810-83f1-670d40336235">
Jul 25 10:11:00 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 10:11:00 user nova-compute[71312]:         </nova:port>
Jul 25 10:11:00 user nova-compute[71312]:       </nova:ports>
Jul 25 10:11:00 user nova-compute[71312]:     </nova:instance>
Jul 25 10:11:00 user nova-compute[71312]:   </metadata>
Jul 25 10:11:00 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:11:00 user nova-compute[71312]:     <system>
Jul 25 10:11:00 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:11:00 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:11:00 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:11:00 user nova-compute[71312]:       <entry name="serial">3d7de169-d5d4-4dc6-9980-ce586554323c</entry>
Jul 25 10:11:00 user nova-compute[71312]:       <entry name="uuid">3d7de169-d5d4-4dc6-9980-ce586554323c</entry>
Jul 25 10:11:00 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:11:00 user nova-compute[71312]:     </system>
Jul 25 10:11:00 user nova-compute[71312]:   </sysinfo>
Jul 25 10:11:00 user nova-compute[71312]:   <os>
Jul 25 10:11:00 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:11:00 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:11:00 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:11:00 user nova-compute[71312]:   </os>
Jul 25 10:11:00 user nova-compute[71312]:   <features>
Jul 25 10:11:00 user nova-compute[71312]:     <acpi/>
Jul 25 10:11:00 user nova-compute[71312]:     <apic/>
Jul 25 10:11:00 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:11:00 user nova-compute[71312]:   </features>
Jul 25 10:11:00 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:11:00 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:11:00 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:11:00 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:11:00 user nova-compute[71312]:   </clock>
Jul 25 10:11:00 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:11:00 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:11:00 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:11:00 user nova-compute[71312]:   </cpu>
Jul 25 10:11:00 user nova-compute[71312]:   <devices>
Jul 25 10:11:00 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:11:00 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:11:00 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk"/>
Jul 25 10:11:00 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:11:00 user nova-compute[71312]:     </disk>
Jul 25 10:11:00 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:11:00 user nova-compute[71312]:       <mac address="fa:16:3e:a2:38:4d"/>
Jul 25 10:11:00 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:11:00 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:11:00 user nova-compute[71312]:       <target dev="tap8142a6be-13"/>
Jul 25 10:11:00 user nova-compute[71312]:     </interface>
Jul 25 10:11:00 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:11:00 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/console.log" append="off"/>
Jul 25 10:11:00 user nova-compute[71312]:     </serial>
Jul 25 10:11:00 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:11:00 user nova-compute[71312]:     <video>
Jul 25 10:11:00 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:11:00 user nova-compute[71312]:     </video>
Jul 25 10:11:00 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:11:00 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:11:00 user nova-compute[71312]:     </rng>
Jul 25 10:11:00 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:11:00 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:11:00 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:11:00 user nova-compute[71312]:     </memballoon>
Jul 25 10:11:00 user nova-compute[71312]:   </devices>
Jul 25 10:11:00 user nova-compute[71312]: </domain>
Jul 25 10:11:00 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1731897971',display_name='tempest-AttachVolumeTestJSON-server-1731897971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1731897971',id=24,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP76U8pOmQj0T6UoWSIE8MwYl2QViBDvJlo+6VIrFrd7xplbfhajk4osrb3h0o5ol89Nr8I1EP7YXP/3x5K5kTv1MomBI4WO3sMBcDllyxK4gqCJXNgaWE4MYBg1SFtLiQ==',key_name='tempest-keypair-689919311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68cb9228183844d5853c6c2a35f2658f',ramdisk_id='',reservation_id='r-vgzgne07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1095711794',owner_user_name='tempest-AttachVolumeTestJSON-1095711794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48272d2a58644b2b8b6a9c42b51c746',uuid=3d7de169-d5d4-4dc6-9980-ce586554323c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8142a6be-137e-4810-83f1-670d40336235", "address": "fa:16:3e:a2:38:4d", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8142a6be-13", "ovs_interfaceid": "8142a6be-137e-4810-83f1-670d40336235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converting VIF {"id": "8142a6be-137e-4810-83f1-670d40336235", "address": "fa:16:3e:a2:38:4d", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8142a6be-13", "ovs_interfaceid": "8142a6be-137e-4810-83f1-670d40336235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:38:4d,bridge_name='br-int',has_traffic_filtering=True,id=8142a6be-137e-4810-83f1-670d40336235,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8142a6be-13') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG os_vif [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:38:4d,bridge_name='br-int',has_traffic_filtering=True,id=8142a6be-137e-4810-83f1-670d40336235,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8142a6be-13') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8142a6be-13, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8142a6be-13, col_values=(('external_ids', {'iface-id': '8142a6be-137e-4810-83f1-670d40336235', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:38:4d', 'vm-uuid': '3d7de169-d5d4-4dc6-9980-ce586554323c'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:00 user nova-compute[71312]: INFO os_vif [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:38:4d,bridge_name='br-int',has_traffic_filtering=True,id=8142a6be-137e-4810-83f1-670d40336235,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8142a6be-13')
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] No VIF found with MAC fa:16:3e:a2:38:4d, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.network.neutron [req-073d8e4a-0591-46df-a491-421b9ed0beb8 req-5d42e3de-7572-48a0-8409-f14dc92a1687 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Updated VIF entry in instance network info cache for port 8142a6be-137e-4810-83f1-670d40336235. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG nova.network.neutron [req-073d8e4a-0591-46df-a491-421b9ed0beb8 req-5d42e3de-7572-48a0-8409-f14dc92a1687 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Updating instance_info_cache with network_info: [{"id": "8142a6be-137e-4810-83f1-670d40336235", "address": "fa:16:3e:a2:38:4d", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8142a6be-13", "ovs_interfaceid": "8142a6be-137e-4810-83f1-670d40336235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-073d8e4a-0591-46df-a491-421b9ed0beb8 req-5d42e3de-7572-48a0-8409-f14dc92a1687 service nova] Releasing lock "refresh_cache-3d7de169-d5d4-4dc6-9980-ce586554323c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:11:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Snapshot image upload complete
Jul 25 10:11:02 user nova-compute[71312]: INFO nova.compute.manager [None req-592647e9-70de-4dfd-a578-82bf8b899c7e tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Took 5.78 seconds to snapshot the instance on the hypervisor.
Jul 25 10:11:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-6211a302-eae7-45e7-967f-42789384cbf7 req-fdb6bb04-2e57-4110-aa9f-19083b9b16a9 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Received event network-vif-plugged-8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6211a302-eae7-45e7-967f-42789384cbf7 req-fdb6bb04-2e57-4110-aa9f-19083b9b16a9 service nova] Acquiring lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6211a302-eae7-45e7-967f-42789384cbf7 req-fdb6bb04-2e57-4110-aa9f-19083b9b16a9 service nova] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6211a302-eae7-45e7-967f-42789384cbf7 req-fdb6bb04-2e57-4110-aa9f-19083b9b16a9 service nova] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-6211a302-eae7-45e7-967f-42789384cbf7 req-fdb6bb04-2e57-4110-aa9f-19083b9b16a9 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] No waiting events found dispatching network-vif-plugged-8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:02 user nova-compute[71312]: WARNING nova.compute.manager [req-6211a302-eae7-45e7-967f-42789384cbf7 req-fdb6bb04-2e57-4110-aa9f-19083b9b16a9 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Received unexpected event network-vif-plugged-8142a6be-137e-4810-83f1-670d40336235 for instance with vm_state building and task_state spawning.
Jul 25 10:11:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279864.3045607, 3d7de169-d5d4-4dc6-9980-ce586554323c => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:11:04 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] VM Resumed (Lifecycle Event)
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:11:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Instance spawned successfully.
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:04 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279864.308027, 3d7de169-d5d4-4dc6-9980-ce586554323c => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:11:04 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] VM Started (Lifecycle Event)
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:11:04 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:11:04 user nova-compute[71312]: INFO nova.compute.manager [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Took 6.57 seconds to spawn the instance on the hypervisor.
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:04 user nova-compute[71312]: INFO nova.compute.manager [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Took 7.39 seconds to build instance.
Jul 25 10:11:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53c32823-2086-41ad-b3ca-12b961e63244 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.514s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-f686a475-39e7-472b-a9a4-4dbd9ab893a5 req-c405d34f-fc69-449b-b09d-50bbeb8350aa service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Received event network-vif-plugged-8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f686a475-39e7-472b-a9a4-4dbd9ab893a5 req-c405d34f-fc69-449b-b09d-50bbeb8350aa service nova] Acquiring lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f686a475-39e7-472b-a9a4-4dbd9ab893a5 req-c405d34f-fc69-449b-b09d-50bbeb8350aa service nova] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f686a475-39e7-472b-a9a4-4dbd9ab893a5 req-c405d34f-fc69-449b-b09d-50bbeb8350aa service nova] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-f686a475-39e7-472b-a9a4-4dbd9ab893a5 req-c405d34f-fc69-449b-b09d-50bbeb8350aa service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] No waiting events found dispatching network-vif-plugged-8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:04 user nova-compute[71312]: WARNING nova.compute.manager [req-f686a475-39e7-472b-a9a4-4dbd9ab893a5 req-c405d34f-fc69-449b-b09d-50bbeb8350aa service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Received unexpected event network-vif-plugged-8142a6be-137e-4810-83f1-670d40336235 for instance with vm_state active and task_state None.
Jul 25 10:11:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:06 user nova-compute[71312]: INFO nova.compute.manager [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Terminating instance
Jul 25 10:11:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:11:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-ea3630c6-5e56-4246-90b6-7a8dae8e71ad req-66cbcce7-7381-456d-be27-5eb7f654b654 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Received event network-vif-unplugged-21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ea3630c6-5e56-4246-90b6-7a8dae8e71ad req-66cbcce7-7381-456d-be27-5eb7f654b654 service nova] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ea3630c6-5e56-4246-90b6-7a8dae8e71ad req-66cbcce7-7381-456d-be27-5eb7f654b654 service nova] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ea3630c6-5e56-4246-90b6-7a8dae8e71ad req-66cbcce7-7381-456d-be27-5eb7f654b654 service nova] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-ea3630c6-5e56-4246-90b6-7a8dae8e71ad req-66cbcce7-7381-456d-be27-5eb7f654b654 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] No waiting events found dispatching network-vif-unplugged-21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-ea3630c6-5e56-4246-90b6-7a8dae8e71ad req-66cbcce7-7381-456d-be27-5eb7f654b654 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Received event network-vif-unplugged-21d54204-0541-4b46-9c4b-13a826123e4a for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:11:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Instance destroyed successfully.
Jul 25 10:11:07 user nova-compute[71312]: DEBUG nova.objects.instance [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lazy-loading 'resources' on Instance uuid 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1061246116',display_name='tempest-SnapshotDataIntegrityTests-server-1061246116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1061246116',id=14,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtjccPguT409ZXRU6u7UoQUOgW9/tET9J5QtvrXhkszx0vFHXoPt0oBZuHwAltGGPwFP4jxAK4qRYyHhKsbR5Z0cppn5k/q4v7peCa+3lt+wBmB33LSpOftA29SFYsghQ==',key_name='tempest-keypair-449794532',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:03:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c3e67aaa7e94f2ab8d700776bc203e4',ramdisk_id='',reservation_id='r-a3vh9se2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-872571308',owner_user_name='tempest-SnapshotDataIntegrityTests-872571308-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f7533403acd4dc7a410015efa392724',uuid=8d5e4107-7c28-4c75-aa0a-9e467f0536d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21d54204-0541-4b46-9c4b-13a826123e4a", "address": "fa:16:3e:30:3b:71", "network": {"id": "07adb718-1379-4f03-80cb-84fb5ea2f086", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1044212390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c3e67aaa7e94f2ab8d700776bc203e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d54204-05", "ovs_interfaceid": "21d54204-0541-4b46-9c4b-13a826123e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Converting VIF {"id": "21d54204-0541-4b46-9c4b-13a826123e4a", "address": "fa:16:3e:30:3b:71", "network": {"id": "07adb718-1379-4f03-80cb-84fb5ea2f086", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1044212390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c3e67aaa7e94f2ab8d700776bc203e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d54204-05", "ovs_interfaceid": "21d54204-0541-4b46-9c4b-13a826123e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:3b:71,bridge_name='br-int',has_traffic_filtering=True,id=21d54204-0541-4b46-9c4b-13a826123e4a,network=Network(07adb718-1379-4f03-80cb-84fb5ea2f086),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d54204-05') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG os_vif [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:3b:71,bridge_name='br-int',has_traffic_filtering=True,id=21d54204-0541-4b46-9c4b-13a826123e4a,network=Network(07adb718-1379-4f03-80cb-84fb5ea2f086),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d54204-05') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21d54204-05, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:11:07 user nova-compute[71312]: INFO os_vif [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:3b:71,bridge_name='br-int',has_traffic_filtering=True,id=21d54204-0541-4b46-9c4b-13a826123e4a,network=Network(07adb718-1379-4f03-80cb-84fb5ea2f086),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d54204-05')
Jul 25 10:11:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Deleting instance files /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6_del
Jul 25 10:11:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Deletion of /opt/stack/data/nova/instances/8d5e4107-7c28-4c75-aa0a-9e467f0536d6_del complete
Jul 25 10:11:07 user nova-compute[71312]: INFO nova.compute.manager [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 25 10:11:07 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:11:07 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:11:08 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-ad53dd38-4976-419d-b35f-358dac445732 req-cc1a4c40-a08d-4873-a5ae-3b995972c43c service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Received event network-vif-deleted-21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:08 user nova-compute[71312]: INFO nova.compute.manager [req-ad53dd38-4976-419d-b35f-358dac445732 req-cc1a4c40-a08d-4873-a5ae-3b995972c43c service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Neutron deleted interface 21d54204-0541-4b46-9c4b-13a826123e4a; detaching it from the instance and deleting it from the info cache
Jul 25 10:11:08 user nova-compute[71312]: DEBUG nova.network.neutron [req-ad53dd38-4976-419d-b35f-358dac445732 req-cc1a4c40-a08d-4873-a5ae-3b995972c43c service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:08 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Took 0.92 seconds to deallocate network for instance.
Jul 25 10:11:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-ad53dd38-4976-419d-b35f-358dac445732 req-cc1a4c40-a08d-4873-a5ae-3b995972c43c service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Detach interface failed, port_id=21d54204-0541-4b46-9c4b-13a826123e4a, reason: Instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:11:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:09 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:11:09 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:11:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:09 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Deleted allocations for instance 8d5e4107-7c28-4c75-aa0a-9e467f0536d6
Jul 25 10:11:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-17a5c25c-d346-4566-a2db-f11bae1e275f tempest-SnapshotDataIntegrityTests-872571308 tempest-SnapshotDataIntegrityTests-872571308-project-member] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.472s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-4a72bd1b-78f3-4cf0-95ee-239e9fc369d2 req-f777e713-bbc2-4abc-a9f5-eed16fb8c758 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Received event network-vif-plugged-21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4a72bd1b-78f3-4cf0-95ee-239e9fc369d2 req-f777e713-bbc2-4abc-a9f5-eed16fb8c758 service nova] Acquiring lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4a72bd1b-78f3-4cf0-95ee-239e9fc369d2 req-f777e713-bbc2-4abc-a9f5-eed16fb8c758 service nova] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4a72bd1b-78f3-4cf0-95ee-239e9fc369d2 req-f777e713-bbc2-4abc-a9f5-eed16fb8c758 service nova] Lock "8d5e4107-7c28-4c75-aa0a-9e467f0536d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-4a72bd1b-78f3-4cf0-95ee-239e9fc369d2 req-f777e713-bbc2-4abc-a9f5-eed16fb8c758 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] No waiting events found dispatching network-vif-plugged-21d54204-0541-4b46-9c4b-13a826123e4a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:09 user nova-compute[71312]: WARNING nova.compute.manager [req-4a72bd1b-78f3-4cf0-95ee-239e9fc369d2 req-f777e713-bbc2-4abc-a9f5-eed16fb8c758 service nova] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Received unexpected event network-vif-plugged-21d54204-0541-4b46-9c4b-13a826123e4a for instance with vm_state deleted and task_state None.
Jul 25 10:11:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "93f45579-3a72-4646-8d47-2f47217e7ead" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "93f45579-3a72-4646-8d47-2f47217e7ead" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:15 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:11:15 user nova-compute[71312]: INFO nova.compute.claims [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Claim successful on node user
Jul 25 10:11:15 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:11:15 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:11:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:11:15 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG nova.policy [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fe1a69013de4b4dbcb98a35e48d8ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a09fcc394c945c2b843abf3df53cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:11:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:11:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "e47e9004-c0fb-45a4-8f65-78f1685e5105" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "e47e9004-c0fb-45a4-8f65-78f1685e5105" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:16 user nova-compute[71312]: INFO nova.compute.manager [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Terminating instance
Jul 25 10:11:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:11:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Creating image(s)
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "/opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "/opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "/opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.224s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.161s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-0a02648f-5955-491f-8499-bc88e27405e9 req-452f5a72-55f6-48e0-bbec-943c1ad20c0b service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Received event network-vif-unplugged-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0a02648f-5955-491f-8499-bc88e27405e9 req-452f5a72-55f6-48e0-bbec-943c1ad20c0b service nova] Acquiring lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0a02648f-5955-491f-8499-bc88e27405e9 req-452f5a72-55f6-48e0-bbec-943c1ad20c0b service nova] Lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0a02648f-5955-491f-8499-bc88e27405e9 req-452f5a72-55f6-48e0-bbec-943c1ad20c0b service nova] Lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-0a02648f-5955-491f-8499-bc88e27405e9 req-452f5a72-55f6-48e0-bbec-943c1ad20c0b service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] No waiting events found dispatching network-vif-unplugged-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-0a02648f-5955-491f-8499-bc88e27405e9 req-452f5a72-55f6-48e0-bbec-943c1ad20c0b service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Received event network-vif-unplugged-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk 1073741824" returned: 0 in 0.074s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:16 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Successfully created port: f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.163s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Instance destroyed successfully.
Jul 25 10:11:17 user nova-compute[71312]: DEBUG nova.objects.instance [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lazy-loading 'resources' on Instance uuid e47e9004-c0fb-45a4-8f65-78f1685e5105 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1024697111',display_name='tempest-VolumesActionsTest-instance-1024697111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1024697111',id=21,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:09:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b43f656906af4f9e99608f46026618dd',ramdisk_id='',reservation_id='r-xw5y5g0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1049905673',owner_user_name='tempest-VolumesActionsTest-1049905673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:09:35Z,user_data=None,user_id='8ca2145682dd42388f078b2236c2a196',uuid=e47e9004-c0fb-45a4-8f65-78f1685e5105,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "address": "fa:16:3e:41:5e:ed", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c1883d-bc", "ovs_interfaceid": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Converting VIF {"id": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "address": "fa:16:3e:41:5e:ed", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c1883d-bc", "ovs_interfaceid": "d0c1883d-bc01-4134-9f0f-9a4a61cfa05f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:5e:ed,bridge_name='br-int',has_traffic_filtering=True,id=d0c1883d-bc01-4134-9f0f-9a4a61cfa05f,network=Network(19db69ce-484c-42ca-932f-688f1da7f111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0c1883d-bc') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG os_vif [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:5e:ed,bridge_name='br-int',has_traffic_filtering=True,id=d0c1883d-bc01-4134-9f0f-9a4a61cfa05f,network=Network(19db69ce-484c-42ca-932f-688f1da7f111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0c1883d-bc') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0c1883d-bc, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:11:17 user nova-compute[71312]: INFO os_vif [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:5e:ed,bridge_name='br-int',has_traffic_filtering=True,id=d0c1883d-bc01-4134-9f0f-9a4a61cfa05f,network=Network(19db69ce-484c-42ca-932f-688f1da7f111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0c1883d-bc')
Jul 25 10:11:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Deleting instance files /opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105_del
Jul 25 10:11:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Deletion of /opt/stack/data/nova/instances/e47e9004-c0fb-45a4-8f65-78f1685e5105_del complete
Jul 25 10:11:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Cannot resize image /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'migration_context' on Instance uuid 93f45579-3a72-4646-8d47-2f47217e7ead {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Ensure instance console log exists: /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:17 user nova-compute[71312]: INFO nova.compute.manager [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Took 1.00 seconds to destroy the instance on the hypervisor.
Jul 25 10:11:17 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:11:17 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:11:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-220d47e9-51f5-4ed8-957b-b0ae588b2f5e req-b989bf1d-38ba-442a-bbf3-bf707b55f273 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-changed-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-220d47e9-51f5-4ed8-957b-b0ae588b2f5e req-b989bf1d-38ba-442a-bbf3-bf707b55f273 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Refreshing instance network info cache due to event network-changed-d1cb436a-ed84-43ea-a32f-6c08effc60d6. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:11:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-220d47e9-51f5-4ed8-957b-b0ae588b2f5e req-b989bf1d-38ba-442a-bbf3-bf707b55f273 service nova] Acquiring lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:11:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-220d47e9-51f5-4ed8-957b-b0ae588b2f5e req-b989bf1d-38ba-442a-bbf3-bf707b55f273 service nova] Acquired lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:11:18 user nova-compute[71312]: DEBUG nova.network.neutron [req-220d47e9-51f5-4ed8-957b-b0ae588b2f5e req-b989bf1d-38ba-442a-bbf3-bf707b55f273 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Refreshing network info cache for port d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:11:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-c0006a04-3892-434c-9fb4-4b1bd0fa95fc req-90580024-0d1a-4e06-83e0-55da304e9adf service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Received event network-vif-plugged-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c0006a04-3892-434c-9fb4-4b1bd0fa95fc req-90580024-0d1a-4e06-83e0-55da304e9adf service nova] Acquiring lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c0006a04-3892-434c-9fb4-4b1bd0fa95fc req-90580024-0d1a-4e06-83e0-55da304e9adf service nova] Lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c0006a04-3892-434c-9fb4-4b1bd0fa95fc req-90580024-0d1a-4e06-83e0-55da304e9adf service nova] Lock "e47e9004-c0fb-45a4-8f65-78f1685e5105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-c0006a04-3892-434c-9fb4-4b1bd0fa95fc req-90580024-0d1a-4e06-83e0-55da304e9adf service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] No waiting events found dispatching network-vif-plugged-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:18 user nova-compute[71312]: WARNING nova.compute.manager [req-c0006a04-3892-434c-9fb4-4b1bd0fa95fc req-90580024-0d1a-4e06-83e0-55da304e9adf service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Received unexpected event network-vif-plugged-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f for instance with vm_state active and task_state deleting.
Jul 25 10:11:18 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Successfully updated port: f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:11:18 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Took 1.73 seconds to deallocate network for instance.
Jul 25 10:11:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "refresh_cache-93f45579-3a72-4646-8d47-2f47217e7ead" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquired lock "refresh_cache-93f45579-3a72-4646-8d47-2f47217e7ead" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-61831f9b-7bfd-4f3e-8286-a867ae0bb1a4 req-3e040af0-784e-446a-9aa4-5b4b917bd5d9 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Received event network-changed-f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-61831f9b-7bfd-4f3e-8286-a867ae0bb1a4 req-3e040af0-784e-446a-9aa4-5b4b917bd5d9 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Refreshing instance network info cache due to event network-changed-f8788bc7-a010-4631-be89-f443cff123be. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-61831f9b-7bfd-4f3e-8286-a867ae0bb1a4 req-3e040af0-784e-446a-9aa4-5b4b917bd5d9 service nova] Acquiring lock "refresh_cache-93f45579-3a72-4646-8d47-2f47217e7ead" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Updating instance_info_cache with network_info: [{"id": "f8788bc7-a010-4631-be89-f443cff123be", "address": "fa:16:3e:77:ff:1b", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8788bc7-a0", "ovs_interfaceid": "f8788bc7-a010-4631-be89-f443cff123be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:19 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Deleted allocations for instance e47e9004-c0fb-45a4-8f65-78f1685e5105
Jul 25 10:11:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Releasing lock "refresh_cache-93f45579-3a72-4646-8d47-2f47217e7ead" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Instance network_info: |[{"id": "f8788bc7-a010-4631-be89-f443cff123be", "address": "fa:16:3e:77:ff:1b", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8788bc7-a0", "ovs_interfaceid": "f8788bc7-a010-4631-be89-f443cff123be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-61831f9b-7bfd-4f3e-8286-a867ae0bb1a4 req-3e040af0-784e-446a-9aa4-5b4b917bd5d9 service nova] Acquired lock "refresh_cache-93f45579-3a72-4646-8d47-2f47217e7ead" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.network.neutron [req-61831f9b-7bfd-4f3e-8286-a867ae0bb1a4 req-3e040af0-784e-446a-9aa4-5b4b917bd5d9 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Refreshing network info cache for port f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Start _get_guest_xml network_info=[{"id": "f8788bc7-a010-4631-be89-f443cff123be", "address": "fa:16:3e:77:ff:1b", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8788bc7-a0", "ovs_interfaceid": "f8788bc7-a010-4631-be89-f443cff123be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:11:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:11:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1069638045',display_name='tempest-AttachVolumeNegativeTest-server-1069638045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1069638045',id=25,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsTFUaboyVgjV6hEqNLlndAZdkK+AXtQlktKocOF/oAqLTvu0h5ApeUm9YqPJcAsEcmG1YYRLBlL1cfGXLdv20pemb1UtZ/jI1pkWg24y49sgU8kwyfZOQJEkQcrKnMVQ==',key_name='tempest-keypair-29371605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a09fcc394c945c2b843abf3df53cda6',ramdisk_id='',reservation_id='r-gt8w7ffd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016049404',owner_user_name='tempest-AttachVolumeNegativeTest-1016049404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:11:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe1a69013de4b4dbcb98a35e48d8ee8',uuid=93f45579-3a72-4646-8d47-2f47217e7ead,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8788bc7-a010-4631-be89-f443cff123be", "address": "fa:16:3e:77:ff:1b", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8788bc7-a0", "ovs_interfaceid": "f8788bc7-a010-4631-be89-f443cff123be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converting VIF {"id": "f8788bc7-a010-4631-be89-f443cff123be", "address": "fa:16:3e:77:ff:1b", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8788bc7-a0", "ovs_interfaceid": "f8788bc7-a010-4631-be89-f443cff123be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:ff:1b,bridge_name='br-int',has_traffic_filtering=True,id=f8788bc7-a010-4631-be89-f443cff123be,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8788bc7-a0') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'pci_devices' on Instance uuid 93f45579-3a72-4646-8d47-2f47217e7ead {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bdd440b9-fa3d-4c2a-b95f-783a0dc46cdf tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "e47e9004-c0fb-45a4-8f65-78f1685e5105" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.418s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:11:19 user nova-compute[71312]:   <uuid>93f45579-3a72-4646-8d47-2f47217e7ead</uuid>
Jul 25 10:11:19 user nova-compute[71312]:   <name>instance-00000019</name>
Jul 25 10:11:19 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:11:19 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:11:19 user nova-compute[71312]:   <metadata>
Jul 25 10:11:19 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:11:19 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:11:19 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1069638045</nova:name>
Jul 25 10:11:19 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:11:19</nova:creationTime>
Jul 25 10:11:19 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:11:19 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:11:19 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:11:19 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:11:19 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:11:19 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:11:19 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:11:19 user nova-compute[71312]:       <nova:owner>
Jul 25 10:11:19 user nova-compute[71312]:         <nova:user uuid="3fe1a69013de4b4dbcb98a35e48d8ee8">tempest-AttachVolumeNegativeTest-1016049404-project-member</nova:user>
Jul 25 10:11:19 user nova-compute[71312]:         <nova:project uuid="0a09fcc394c945c2b843abf3df53cda6">tempest-AttachVolumeNegativeTest-1016049404</nova:project>
Jul 25 10:11:19 user nova-compute[71312]:       </nova:owner>
Jul 25 10:11:19 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:11:19 user nova-compute[71312]:       <nova:ports>
Jul 25 10:11:19 user nova-compute[71312]:         <nova:port uuid="f8788bc7-a010-4631-be89-f443cff123be">
Jul 25 10:11:19 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 10:11:19 user nova-compute[71312]:         </nova:port>
Jul 25 10:11:19 user nova-compute[71312]:       </nova:ports>
Jul 25 10:11:19 user nova-compute[71312]:     </nova:instance>
Jul 25 10:11:19 user nova-compute[71312]:   </metadata>
Jul 25 10:11:19 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:11:19 user nova-compute[71312]:     <system>
Jul 25 10:11:19 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:11:19 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:11:19 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:11:19 user nova-compute[71312]:       <entry name="serial">93f45579-3a72-4646-8d47-2f47217e7ead</entry>
Jul 25 10:11:19 user nova-compute[71312]:       <entry name="uuid">93f45579-3a72-4646-8d47-2f47217e7ead</entry>
Jul 25 10:11:19 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:11:19 user nova-compute[71312]:     </system>
Jul 25 10:11:19 user nova-compute[71312]:   </sysinfo>
Jul 25 10:11:19 user nova-compute[71312]:   <os>
Jul 25 10:11:19 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:11:19 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:11:19 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:11:19 user nova-compute[71312]:   </os>
Jul 25 10:11:19 user nova-compute[71312]:   <features>
Jul 25 10:11:19 user nova-compute[71312]:     <acpi/>
Jul 25 10:11:19 user nova-compute[71312]:     <apic/>
Jul 25 10:11:19 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:11:19 user nova-compute[71312]:   </features>
Jul 25 10:11:19 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:11:19 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:11:19 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:11:19 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:11:19 user nova-compute[71312]:   </clock>
Jul 25 10:11:19 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:11:19 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:11:19 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:11:19 user nova-compute[71312]:   </cpu>
Jul 25 10:11:19 user nova-compute[71312]:   <devices>
Jul 25 10:11:19 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:11:19 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:11:19 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk"/>
Jul 25 10:11:19 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:11:19 user nova-compute[71312]:     </disk>
Jul 25 10:11:19 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:11:19 user nova-compute[71312]:       <mac address="fa:16:3e:77:ff:1b"/>
Jul 25 10:11:19 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:11:19 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:11:19 user nova-compute[71312]:       <target dev="tapf8788bc7-a0"/>
Jul 25 10:11:19 user nova-compute[71312]:     </interface>
Jul 25 10:11:19 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:11:19 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/console.log" append="off"/>
Jul 25 10:11:19 user nova-compute[71312]:     </serial>
Jul 25 10:11:19 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:11:19 user nova-compute[71312]:     <video>
Jul 25 10:11:19 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:11:19 user nova-compute[71312]:     </video>
Jul 25 10:11:19 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:11:19 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:11:19 user nova-compute[71312]:     </rng>
Jul 25 10:11:19 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:11:19 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:11:19 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:11:19 user nova-compute[71312]:     </memballoon>
Jul 25 10:11:19 user nova-compute[71312]:   </devices>
Jul 25 10:11:19 user nova-compute[71312]: </domain>
Jul 25 10:11:19 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1069638045',display_name='tempest-AttachVolumeNegativeTest-server-1069638045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1069638045',id=25,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsTFUaboyVgjV6hEqNLlndAZdkK+AXtQlktKocOF/oAqLTvu0h5ApeUm9YqPJcAsEcmG1YYRLBlL1cfGXLdv20pemb1UtZ/jI1pkWg24y49sgU8kwyfZOQJEkQcrKnMVQ==',key_name='tempest-keypair-29371605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a09fcc394c945c2b843abf3df53cda6',ramdisk_id='',reservation_id='r-gt8w7ffd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016049404',owner_user_name='tempest-AttachVolumeNegativeTest-1016049404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:11:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe1a69013de4b4dbcb98a35e48d8ee8',uuid=93f45579-3a72-4646-8d47-2f47217e7ead,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8788bc7-a010-4631-be89-f443cff123be", "address": "fa:16:3e:77:ff:1b", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8788bc7-a0", "ovs_interfaceid": "f8788bc7-a010-4631-be89-f443cff123be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converting VIF {"id": "f8788bc7-a010-4631-be89-f443cff123be", "address": "fa:16:3e:77:ff:1b", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8788bc7-a0", "ovs_interfaceid": "f8788bc7-a010-4631-be89-f443cff123be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:ff:1b,bridge_name='br-int',has_traffic_filtering=True,id=f8788bc7-a010-4631-be89-f443cff123be,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8788bc7-a0') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG os_vif [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:ff:1b,bridge_name='br-int',has_traffic_filtering=True,id=f8788bc7-a010-4631-be89-f443cff123be,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8788bc7-a0') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8788bc7-a0, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf8788bc7-a0, col_values=(('external_ids', {'iface-id': 'f8788bc7-a010-4631-be89-f443cff123be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:ff:1b', 'vm-uuid': '93f45579-3a72-4646-8d47-2f47217e7ead'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:19 user nova-compute[71312]: INFO os_vif [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:ff:1b,bridge_name='br-int',has_traffic_filtering=True,id=f8788bc7-a010-4631-be89-f443cff123be,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8788bc7-a0')
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:11:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No VIF found with MAC fa:16:3e:77:ff:1b, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:11:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-220d47e9-51f5-4ed8-957b-b0ae588b2f5e req-b989bf1d-38ba-442a-bbf3-bf707b55f273 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updated VIF entry in instance network info cache for port d1cb436a-ed84-43ea-a32f-6c08effc60d6. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:11:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-220d47e9-51f5-4ed8-957b-b0ae588b2f5e req-b989bf1d-38ba-442a-bbf3-bf707b55f273 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updating instance_info_cache with network_info: [{"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-220d47e9-51f5-4ed8-957b-b0ae588b2f5e req-b989bf1d-38ba-442a-bbf3-bf707b55f273 service nova] Releasing lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:11:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-61831f9b-7bfd-4f3e-8286-a867ae0bb1a4 req-3e040af0-784e-446a-9aa4-5b4b917bd5d9 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Updated VIF entry in instance network info cache for port f8788bc7-a010-4631-be89-f443cff123be. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:11:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-61831f9b-7bfd-4f3e-8286-a867ae0bb1a4 req-3e040af0-784e-446a-9aa4-5b4b917bd5d9 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Updating instance_info_cache with network_info: [{"id": "f8788bc7-a010-4631-be89-f443cff123be", "address": "fa:16:3e:77:ff:1b", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8788bc7-a0", "ovs_interfaceid": "f8788bc7-a010-4631-be89-f443cff123be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-61831f9b-7bfd-4f3e-8286-a867ae0bb1a4 req-3e040af0-784e-446a-9aa4-5b4b917bd5d9 service nova] Releasing lock "refresh_cache-93f45579-3a72-4646-8d47-2f47217e7ead" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:11:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-6d006a62-d47c-4397-b10e-c3d0802971da req-cb4a29d9-7958-4939-868a-77deaab88c6a service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received event network-changed-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-6d006a62-d47c-4397-b10e-c3d0802971da req-cb4a29d9-7958-4939-868a-77deaab88c6a service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Refreshing instance network info cache due to event network-changed-7e6bcfd4-3491-4be2-819d-92ed4bed42f7. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:11:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6d006a62-d47c-4397-b10e-c3d0802971da req-cb4a29d9-7958-4939-868a-77deaab88c6a service nova] Acquiring lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:11:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6d006a62-d47c-4397-b10e-c3d0802971da req-cb4a29d9-7958-4939-868a-77deaab88c6a service nova] Acquired lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:11:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-6d006a62-d47c-4397-b10e-c3d0802971da req-cb4a29d9-7958-4939-868a-77deaab88c6a service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Refreshing network info cache for port 7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:11:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-53193fb9-8f6e-4499-bcbe-62265e9893d0 req-397065f9-5798-451e-ac72-ecd9a1d8275d service nova] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Received event network-vif-deleted-d0c1883d-bc01-4134-9f0f-9a4a61cfa05f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Stashing vm_state: active {{(pid=71312) _prep_resize /opt/stack/nova/nova/compute/manager.py:5529}}
Jul 25 10:11:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'pci_requests' on Instance uuid cba49a3e-0ffe-4ea2-a956-bb41c178dd38 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:11:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:11:21 user nova-compute[71312]: INFO nova.compute.claims [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Claim successful on node user
Jul 25 10:11:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'resources' on Instance uuid cba49a3e-0ffe-4ea2-a956-bb41c178dd38 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:11:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'pci_devices' on Instance uuid cba49a3e-0ffe-4ea2-a956-bb41c178dd38 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:11:21 user nova-compute[71312]: INFO nova.compute.resource_tracker [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Updating resource usage from migration 0d134740-a63d-4124-936d-d34c7e863391
Jul 25 10:11:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:22 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:11:22 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:11:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.573s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:22 user nova-compute[71312]: INFO nova.compute.manager [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Migrating
Jul 25 10:11:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:11:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-6d006a62-d47c-4397-b10e-c3d0802971da req-cb4a29d9-7958-4939-868a-77deaab88c6a service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Updated VIF entry in instance network info cache for port 7e6bcfd4-3491-4be2-819d-92ed4bed42f7. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:11:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-6d006a62-d47c-4397-b10e-c3d0802971da req-cb4a29d9-7958-4939-868a-77deaab88c6a service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Updating instance_info_cache with network_info: [{"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6d006a62-d47c-4397-b10e-c3d0802971da req-cb4a29d9-7958-4939-868a-77deaab88c6a service nova] Releasing lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:11:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquired lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:11:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:11:22 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279867.6377654, 8d5e4107-7c28-4c75-aa0a-9e467f0536d6 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:11:22 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] VM Stopped (Lifecycle Event)
Jul 25 10:11:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1012df7f-7740-405d-a1cd-3eb590ba4899 None None] [instance: 8d5e4107-7c28-4c75-aa0a-9e467f0536d6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-ac529199-a67e-4787-8c6f-6f4662f97f2b req-4a57b37f-0d79-46c2-b079-3ece7a11dafb service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Received event network-vif-plugged-f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ac529199-a67e-4787-8c6f-6f4662f97f2b req-4a57b37f-0d79-46c2-b079-3ece7a11dafb service nova] Acquiring lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ac529199-a67e-4787-8c6f-6f4662f97f2b req-4a57b37f-0d79-46c2-b079-3ece7a11dafb service nova] Lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ac529199-a67e-4787-8c6f-6f4662f97f2b req-4a57b37f-0d79-46c2-b079-3ece7a11dafb service nova] Lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-ac529199-a67e-4787-8c6f-6f4662f97f2b req-4a57b37f-0d79-46c2-b079-3ece7a11dafb service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] No waiting events found dispatching network-vif-plugged-f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:23 user nova-compute[71312]: WARNING nova.compute.manager [req-ac529199-a67e-4787-8c6f-6f4662f97f2b req-4a57b37f-0d79-46c2-b079-3ece7a11dafb service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Received unexpected event network-vif-plugged-f8788bc7-a010-4631-be89-f443cff123be for instance with vm_state building and task_state spawning.
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-ac529199-a67e-4787-8c6f-6f4662f97f2b req-4a57b37f-0d79-46c2-b079-3ece7a11dafb service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Received event network-vif-plugged-f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ac529199-a67e-4787-8c6f-6f4662f97f2b req-4a57b37f-0d79-46c2-b079-3ece7a11dafb service nova] Acquiring lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ac529199-a67e-4787-8c6f-6f4662f97f2b req-4a57b37f-0d79-46c2-b079-3ece7a11dafb service nova] Lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ac529199-a67e-4787-8c6f-6f4662f97f2b req-4a57b37f-0d79-46c2-b079-3ece7a11dafb service nova] Lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-ac529199-a67e-4787-8c6f-6f4662f97f2b req-4a57b37f-0d79-46c2-b079-3ece7a11dafb service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] No waiting events found dispatching network-vif-plugged-f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:23 user nova-compute[71312]: WARNING nova.compute.manager [req-ac529199-a67e-4787-8c6f-6f4662f97f2b req-4a57b37f-0d79-46c2-b079-3ece7a11dafb service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Received unexpected event network-vif-plugged-f8788bc7-a010-4631-be89-f443cff123be for instance with vm_state building and task_state spawning.
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Updating instance_info_cache with network_info: [{"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Releasing lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Starting migrate_disk_and_power_off {{(pid=71312) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279883.5283737, 93f45579-3a72-4646-8d47-2f47217e7ead => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:11:23 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] VM Resumed (Lifecycle Event)
Jul 25 10:11:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Instance spawned successfully.
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:23 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279883.5287209, 93f45579-3a72-4646-8d47-2f47217e7ead => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:11:23 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] VM Started (Lifecycle Event)
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:11:23 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:11:23 user nova-compute[71312]: INFO nova.compute.manager [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Took 7.33 seconds to spawn the instance on the hypervisor.
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:23 user nova-compute[71312]: INFO nova.compute.manager [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Took 8.45 seconds to build instance.
Jul 25 10:11:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4ae9842-d1df-4d58-a311-ccad032e97df tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "93f45579-3a72-4646-8d47-2f47217e7ead" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.569s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-fb4f8d6e-ddc4-4806-9b7a-490ba7786b70 req-6cf22ad5-4e08-4c44-a0e3-97b4941bdbbe service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received event network-vif-unplugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb4f8d6e-ddc4-4806-9b7a-490ba7786b70 req-6cf22ad5-4e08-4c44-a0e3-97b4941bdbbe service nova] Acquiring lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb4f8d6e-ddc4-4806-9b7a-490ba7786b70 req-6cf22ad5-4e08-4c44-a0e3-97b4941bdbbe service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb4f8d6e-ddc4-4806-9b7a-490ba7786b70 req-6cf22ad5-4e08-4c44-a0e3-97b4941bdbbe service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-fb4f8d6e-ddc4-4806-9b7a-490ba7786b70 req-6cf22ad5-4e08-4c44-a0e3-97b4941bdbbe service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] No waiting events found dispatching network-vif-unplugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:23 user nova-compute[71312]: WARNING nova.compute.manager [req-fb4f8d6e-ddc4-4806-9b7a-490ba7786b70 req-6cf22ad5-4e08-4c44-a0e3-97b4941bdbbe service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received unexpected event network-vif-unplugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 for instance with vm_state active and task_state resize_migrating.
Jul 25 10:11:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:24 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Instance destroyed successfully.
Jul 25 10:11:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-87945462',display_name='tempest-ServerActionsTestOtherA-server-87945462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-87945462',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7/PiN27E1zNONLGfU75gjTzl6TjLJTSPguo/w/NLGiNWvcFBQAXJk/RsZr2x3/TDzaN8UL9NG26qh75+qbwT35akc6FqjZaWZn3poJMiar+SGmPPXZDxAQP/CqYmNQIw==',key_name='tempest-keypair-2143034637',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c30d33a1a8945fdab6798c94a558444',ramdisk_id='',reservation_id='r-emt2yer0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-408585031',owner_user_name='tempest-ServerActionsTestOtherA-408585031-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfdced66e34e0ba7f9437e71aaee6a',uuid=cba49a3e-0ffe-4ea2-a956-bb41c178dd38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-930793975-network", "vif_mac": "fa:16:3e:39:2e:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converting VIF {"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-930793975-network", "vif_mac": "fa:16:3e:39:2e:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:2e:f4,bridge_name='br-int',has_traffic_filtering=True,id=7e6bcfd4-3491-4be2-819d-92ed4bed42f7,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6bcfd4-34') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_vif [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:2e:f4,bridge_name='br-int',has_traffic_filtering=True,id=7e6bcfd4-3491-4be2-819d-92ed4bed42f7,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6bcfd4-34') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e6bcfd4-34, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:24 user nova-compute[71312]: INFO os_vif [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:2e:f4,bridge_name='br-int',has_traffic_filtering=True,id=7e6bcfd4-3491-4be2-819d-92ed4bed42f7,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6bcfd4-34')
Jul 25 10:11:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRHCGBOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:11:24 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d85664-7c2c-44a8-b13e-3417ec464022]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:11:24 user nova-compute[71312]: No targets found.
Jul 25 10:11:24 user nova-compute[71312]: iSNS:
Jul 25 10:11:24 user nova-compute[71312]: No targets found.
Jul 25 10:11:24 user nova-compute[71312]: STATIC:
Jul 25 10:11:24 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:11:24 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:11:24 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:11:24 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e
Jul 25 10:11:24 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:11:24 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:11:24 user nova-compute[71312]: FIRMWARE:
Jul 25 10:11:24 user nova-compute[71312]: No targets found.
Jul 25 10:11:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:11:24 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:11:24 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[828171fe-111c-4588-999c-67649d284739]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ed7384-1da0-4665-8a25-2fbb1f1fa180]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:11:24 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:11:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:11:24 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:11:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c02980d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e'): ({'sdg'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Removing single pathed devices sdg {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7614a0-e51c-4c03-98d8-d5a260206043]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fa982b-46bd-4555-9407-a1c5309fe6d0]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Flushing IO for device /dev/sdg {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bf216e-6f3a-47ac-be55-27478dc0a2d3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65c3feb-a0e9-4be0-8e17-995d7cefa88f]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a56cb40-de75-4774-8699-5c03b7d4bba5]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff68d3e8-c941-4718-900a-3bf9c2d89996]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260]
Jul 25 10:11:24 user nova-compute[71312]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260] successful.
Jul 25 10:11:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbb14f2-314c-4619-9618-ccf351f1db12]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] <== disconnect_volume: return (396ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:25 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Port 7e6bcfd4-3491-4be2-819d-92ed4bed42f7 binding to destination host user is already ACTIVE {{(pid=71312) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 25 10:11:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-6c598923-5040-4671-8d61-ee2fc638c89c req-6979bfd1-53d0-44ed-b59c-142a7ca03e7f service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received event network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6c598923-5040-4671-8d61-ee2fc638c89c req-6979bfd1-53d0-44ed-b59c-142a7ca03e7f service nova] Acquiring lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6c598923-5040-4671-8d61-ee2fc638c89c req-6979bfd1-53d0-44ed-b59c-142a7ca03e7f service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6c598923-5040-4671-8d61-ee2fc638c89c req-6979bfd1-53d0-44ed-b59c-142a7ca03e7f service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-6c598923-5040-4671-8d61-ee2fc638c89c req-6979bfd1-53d0-44ed-b59c-142a7ca03e7f service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] No waiting events found dispatching network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:26 user nova-compute[71312]: WARNING nova.compute.manager [req-6c598923-5040-4671-8d61-ee2fc638c89c req-6979bfd1-53d0-44ed-b59c-142a7ca03e7f service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received unexpected event network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 for instance with vm_state active and task_state resize_migrated.
Jul 25 10:11:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquired lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Updating instance_info_cache with network_info: [{"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Releasing lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG os_brick.utils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.036s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a9b49c-116f-4bac-9bca-b713e4454625]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4174d92b-55c7-4401-816a-dfc318f705a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab917dc-d69b-4196-ae33-670ee53a902b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c40757-2aa6-4a4f-957a-0574529dc0b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:11:27 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:11:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[964ad604-5701-4658-a00e-904d113f2c48]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG os_brick.utils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:11:27 user nova-compute[71312]: INFO nova.compute.claims [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Claim successful on node user
Jul 25 10:11:27 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Refreshing inventories for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Updating ProviderTree inventory for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Updating inventory in ProviderTree for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Refreshing aggregate associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 10:11:27 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Refreshing trait associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, traits: COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.744s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:11:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:11:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:11:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Creating image(s)
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "/opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "/opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "/opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG nova.policy [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '973a55055ef24c5e92facf5f311bb5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbd5e7b5d6b4aa48bb91c435a296bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.162s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.161s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk 1073741824" returned: 0 in 0.051s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:11:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Cannot resize image /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lazy-loading 'migration_context' on Instance uuid 59f4ee46-2dcc-4609-99a2-d3260be757f3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Ensure instance console log exists: /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updating instance_info_cache with network_info: [{"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Successfully created port: 9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:11:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Successfully updated port: 9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-c00e5a69-8400-45b6-957d-470da73297d3 req-b4f242cb-b7e9-4c3f-987a-fc7d5afce73e service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Received event network-changed-9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-c00e5a69-8400-45b6-957d-470da73297d3 req-b4f242cb-b7e9-4c3f-987a-fc7d5afce73e service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Refreshing instance network info cache due to event network-changed-9064e662-791e-46c5-b2e4-4f849ebba931. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c00e5a69-8400-45b6-957d-470da73297d3 req-b4f242cb-b7e9-4c3f-987a-fc7d5afce73e service nova] Acquiring lock "refresh_cache-59f4ee46-2dcc-4609-99a2-d3260be757f3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c00e5a69-8400-45b6-957d-470da73297d3 req-b4f242cb-b7e9-4c3f-987a-fc7d5afce73e service nova] Acquired lock "refresh_cache-59f4ee46-2dcc-4609-99a2-d3260be757f3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG nova.network.neutron [req-c00e5a69-8400-45b6-957d-470da73297d3 req-b4f242cb-b7e9-4c3f-987a-fc7d5afce73e service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Refreshing network info cache for port 9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "refresh_cache-59f4ee46-2dcc-4609-99a2-d3260be757f3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG nova.network.neutron [req-c00e5a69-8400-45b6-957d-470da73297d3 req-b4f242cb-b7e9-4c3f-987a-fc7d5afce73e service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG nova.network.neutron [req-c00e5a69-8400-45b6-957d-470da73297d3 req-b4f242cb-b7e9-4c3f-987a-fc7d5afce73e service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c00e5a69-8400-45b6-957d-470da73297d3 req-b4f242cb-b7e9-4c3f-987a-fc7d5afce73e service nova] Releasing lock "refresh_cache-59f4ee46-2dcc-4609-99a2-d3260be757f3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquired lock "refresh_cache-59f4ee46-2dcc-4609-99a2-d3260be757f3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Updating instance_info_cache with network_info: [{"id": "9064e662-791e-46c5-b2e4-4f849ebba931", "address": "fa:16:3e:4e:aa:8e", "network": {"id": "8b90228d-c790-453e-9cd3-56aa4386ea58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1601377159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbd5e7b5d6b4aa48bb91c435a296bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9064e662-79", "ovs_interfaceid": "9064e662-791e-46c5-b2e4-4f849ebba931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279877.0735762, e47e9004-c0fb-45a4-8f65-78f1685e5105 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:11:32 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] VM Stopped (Lifecycle Event)
Jul 25 10:11:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Releasing lock "refresh_cache-59f4ee46-2dcc-4609-99a2-d3260be757f3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Instance network_info: |[{"id": "9064e662-791e-46c5-b2e4-4f849ebba931", "address": "fa:16:3e:4e:aa:8e", "network": {"id": "8b90228d-c790-453e-9cd3-56aa4386ea58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1601377159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbd5e7b5d6b4aa48bb91c435a296bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9064e662-79", "ovs_interfaceid": "9064e662-791e-46c5-b2e4-4f849ebba931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Start _get_guest_xml network_info=[{"id": "9064e662-791e-46c5-b2e4-4f849ebba931", "address": "fa:16:3e:4e:aa:8e", "network": {"id": "8b90228d-c790-453e-9cd3-56aa4386ea58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1601377159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbd5e7b5d6b4aa48bb91c435a296bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9064e662-79", "ovs_interfaceid": "9064e662-791e-46c5-b2e4-4f849ebba931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-fabaf6d1-20f2-4b60-a0ab-36e1c342d5b8 None None] [instance: e47e9004-c0fb-45a4-8f65-78f1685e5105] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:11:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7606MB free_disk=25.292171478271484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:11:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2114361647',display_name='tempest-TestServerVolumeAttachmentScenario-server-2114361647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2114361647',id=26,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0yDjV+pcdP4ho4hrfbzcTG2Q96C5vqVmn14gwjX3eNPcIKJ5FcZlLVHbsYNqgb+HWUjDocRYOB2ZmagwR0WEaZ2Tv0xgJyV6HatKkUlPPmeESBR60OBrHUP/e+JV1Okg==',key_name='tempest-keypair-851669920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbd5e7b5d6b4aa48bb91c435a296bbd',ramdisk_id='',reservation_id='r-0i8haldc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2136889903',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2136889903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='973a55055ef24c5e92facf5f311bb5f0',uuid=59f4ee46-2dcc-4609-99a2-d3260be757f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9064e662-791e-46c5-b2e4-4f849ebba931", "address": "fa:16:3e:4e:aa:8e", "network": {"id": "8b90228d-c790-453e-9cd3-56aa4386ea58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1601377159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbd5e7b5d6b4aa48bb91c435a296bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9064e662-79", "ovs_interfaceid": "9064e662-791e-46c5-b2e4-4f849ebba931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Converting VIF {"id": "9064e662-791e-46c5-b2e4-4f849ebba931", "address": "fa:16:3e:4e:aa:8e", "network": {"id": "8b90228d-c790-453e-9cd3-56aa4386ea58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1601377159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbd5e7b5d6b4aa48bb91c435a296bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9064e662-79", "ovs_interfaceid": "9064e662-791e-46c5-b2e4-4f849ebba931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=9064e662-791e-46c5-b2e4-4f849ebba931,network=Network(8b90228d-c790-453e-9cd3-56aa4386ea58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9064e662-79') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lazy-loading 'pci_devices' on Instance uuid 59f4ee46-2dcc-4609-99a2-d3260be757f3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:11:32 user nova-compute[71312]:   <uuid>59f4ee46-2dcc-4609-99a2-d3260be757f3</uuid>
Jul 25 10:11:32 user nova-compute[71312]:   <name>instance-0000001a</name>
Jul 25 10:11:32 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:11:32 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:11:32 user nova-compute[71312]:   <metadata>
Jul 25 10:11:32 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:11:32 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:11:32 user nova-compute[71312]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2114361647</nova:name>
Jul 25 10:11:32 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:11:32</nova:creationTime>
Jul 25 10:11:32 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:11:32 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:11:32 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:11:32 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:11:32 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:11:32 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:11:32 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:11:32 user nova-compute[71312]:       <nova:owner>
Jul 25 10:11:32 user nova-compute[71312]:         <nova:user uuid="973a55055ef24c5e92facf5f311bb5f0">tempest-TestServerVolumeAttachmentScenario-2136889903-project-member</nova:user>
Jul 25 10:11:32 user nova-compute[71312]:         <nova:project uuid="5fbd5e7b5d6b4aa48bb91c435a296bbd">tempest-TestServerVolumeAttachmentScenario-2136889903</nova:project>
Jul 25 10:11:32 user nova-compute[71312]:       </nova:owner>
Jul 25 10:11:32 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:11:32 user nova-compute[71312]:       <nova:ports>
Jul 25 10:11:32 user nova-compute[71312]:         <nova:port uuid="9064e662-791e-46c5-b2e4-4f849ebba931">
Jul 25 10:11:32 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 10:11:32 user nova-compute[71312]:         </nova:port>
Jul 25 10:11:32 user nova-compute[71312]:       </nova:ports>
Jul 25 10:11:32 user nova-compute[71312]:     </nova:instance>
Jul 25 10:11:32 user nova-compute[71312]:   </metadata>
Jul 25 10:11:32 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:11:32 user nova-compute[71312]:     <system>
Jul 25 10:11:32 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:11:32 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:11:32 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:11:32 user nova-compute[71312]:       <entry name="serial">59f4ee46-2dcc-4609-99a2-d3260be757f3</entry>
Jul 25 10:11:32 user nova-compute[71312]:       <entry name="uuid">59f4ee46-2dcc-4609-99a2-d3260be757f3</entry>
Jul 25 10:11:32 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:11:32 user nova-compute[71312]:     </system>
Jul 25 10:11:32 user nova-compute[71312]:   </sysinfo>
Jul 25 10:11:32 user nova-compute[71312]:   <os>
Jul 25 10:11:32 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:11:32 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:11:32 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:11:32 user nova-compute[71312]:   </os>
Jul 25 10:11:32 user nova-compute[71312]:   <features>
Jul 25 10:11:32 user nova-compute[71312]:     <acpi/>
Jul 25 10:11:32 user nova-compute[71312]:     <apic/>
Jul 25 10:11:32 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:11:32 user nova-compute[71312]:   </features>
Jul 25 10:11:32 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:11:32 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:11:32 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:11:32 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:11:32 user nova-compute[71312]:   </clock>
Jul 25 10:11:32 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:11:32 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:11:32 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:11:32 user nova-compute[71312]:   </cpu>
Jul 25 10:11:32 user nova-compute[71312]:   <devices>
Jul 25 10:11:32 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:11:32 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:11:32 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk"/>
Jul 25 10:11:32 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:11:32 user nova-compute[71312]:     </disk>
Jul 25 10:11:32 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:11:32 user nova-compute[71312]:       <mac address="fa:16:3e:4e:aa:8e"/>
Jul 25 10:11:32 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:11:32 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:11:32 user nova-compute[71312]:       <target dev="tap9064e662-79"/>
Jul 25 10:11:32 user nova-compute[71312]:     </interface>
Jul 25 10:11:32 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:11:32 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/console.log" append="off"/>
Jul 25 10:11:32 user nova-compute[71312]:     </serial>
Jul 25 10:11:32 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:11:32 user nova-compute[71312]:     <video>
Jul 25 10:11:32 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:11:32 user nova-compute[71312]:     </video>
Jul 25 10:11:32 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:11:32 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:11:32 user nova-compute[71312]:     </rng>
Jul 25 10:11:32 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:11:32 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:11:32 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:11:32 user nova-compute[71312]:     </memballoon>
Jul 25 10:11:32 user nova-compute[71312]:   </devices>
Jul 25 10:11:32 user nova-compute[71312]: </domain>
Jul 25 10:11:32 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2114361647',display_name='tempest-TestServerVolumeAttachmentScenario-server-2114361647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2114361647',id=26,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0yDjV+pcdP4ho4hrfbzcTG2Q96C5vqVmn14gwjX3eNPcIKJ5FcZlLVHbsYNqgb+HWUjDocRYOB2ZmagwR0WEaZ2Tv0xgJyV6HatKkUlPPmeESBR60OBrHUP/e+JV1Okg==',key_name='tempest-keypair-851669920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbd5e7b5d6b4aa48bb91c435a296bbd',ramdisk_id='',reservation_id='r-0i8haldc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2136889903',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2136889903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='973a55055ef24c5e92facf5f311bb5f0',uuid=59f4ee46-2dcc-4609-99a2-d3260be757f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9064e662-791e-46c5-b2e4-4f849ebba931", "address": "fa:16:3e:4e:aa:8e", "network": {"id": "8b90228d-c790-453e-9cd3-56aa4386ea58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1601377159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbd5e7b5d6b4aa48bb91c435a296bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9064e662-79", "ovs_interfaceid": "9064e662-791e-46c5-b2e4-4f849ebba931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Converting VIF {"id": "9064e662-791e-46c5-b2e4-4f849ebba931", "address": "fa:16:3e:4e:aa:8e", "network": {"id": "8b90228d-c790-453e-9cd3-56aa4386ea58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1601377159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbd5e7b5d6b4aa48bb91c435a296bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9064e662-79", "ovs_interfaceid": "9064e662-791e-46c5-b2e4-4f849ebba931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=9064e662-791e-46c5-b2e4-4f849ebba931,network=Network(8b90228d-c790-453e-9cd3-56aa4386ea58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9064e662-79') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG os_vif [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=9064e662-791e-46c5-b2e4-4f849ebba931,network=Network(8b90228d-c790-453e-9cd3-56aa4386ea58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9064e662-79') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9064e662-79, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9064e662-79, col_values=(('external_ids', {'iface-id': '9064e662-791e-46c5-b2e4-4f849ebba931', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:aa:8e', 'vm-uuid': '59f4ee46-2dcc-4609-99a2-d3260be757f3'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:32 user nova-compute[71312]: INFO os_vif [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=9064e662-791e-46c5-b2e4-4f849ebba931,network=Network(8b90228d-c790-453e-9cd3-56aa4386ea58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9064e662-79')
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Applying migration context for instance cba49a3e-0ffe-4ea2-a956-bb41c178dd38 as it has an incoming, in-progress migration 0d134740-a63d-4124-936d-d34c7e863391. Migration status is post-migrating {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 25 10:11:32 user nova-compute[71312]: INFO nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Updating resource usage from migration 0d134740-a63d-4124-936d-d34c7e863391
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] No VIF found with MAC fa:16:3e:4e:aa:8e, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9be175c2-20a4-45ce-85a7-ee3c406a4b1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 2e01c123-09c0-4a29-abf0-727f61484747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 80e8cdf1-c86a-43aa-a66c-46af281187a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 3d7de169-d5d4-4dc6-9980-ce586554323c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 93f45579-3a72-4646-8d47-2f47217e7ead actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Migration 0d134740-a63d-4124-936d-d34c7e863391 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance cba49a3e-0ffe-4ea2-a956-bb41c178dd38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 59f4ee46-2dcc-4609-99a2-d3260be757f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:11:32 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:11:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:11:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:11:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 10:11:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:11:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 10:11:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-bcdd2152-90a3-48d1-9767-a8fef37fa20c req-08812223-d321-4014-87bb-74055c2d7fbc service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Received event network-vif-plugged-9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bcdd2152-90a3-48d1-9767-a8fef37fa20c req-08812223-d321-4014-87bb-74055c2d7fbc service nova] Acquiring lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bcdd2152-90a3-48d1-9767-a8fef37fa20c req-08812223-d321-4014-87bb-74055c2d7fbc service nova] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bcdd2152-90a3-48d1-9767-a8fef37fa20c req-08812223-d321-4014-87bb-74055c2d7fbc service nova] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-bcdd2152-90a3-48d1-9767-a8fef37fa20c req-08812223-d321-4014-87bb-74055c2d7fbc service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] No waiting events found dispatching network-vif-plugged-9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:34 user nova-compute[71312]: WARNING nova.compute.manager [req-bcdd2152-90a3-48d1-9767-a8fef37fa20c req-08812223-d321-4014-87bb-74055c2d7fbc service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Received unexpected event network-vif-plugged-9064e662-791e-46c5-b2e4-4f849ebba931 for instance with vm_state building and task_state spawning.
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Starting finish_migration {{(pid=71312) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 10:11:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Creating image(s)
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Ensure instance console log exists: /opt/stack/data/nova/instances/cba49a3e-0ffe-4ea2-a956-bb41c178dd38/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Start _get_guest_xml network_info=[{"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-930793975-network", "vif_mac": "fa:16:3e:39:2e:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '487b0eab-1e1a-44a5-9657-943c8f03b53e', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRHCGBOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'cba49a3e-0ffe-4ea2-a956-bb41c178dd38', 'attached_at': '2023-07-25T10:11:34.000000', 'detached_at': '', 'volume_id': '81927262-7d9a-4a7e-b71b-c0508ba11c5e', 'serial': '81927262-7d9a-4a7e-b71b-c0508ba11c5e'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:11:34 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:11:34 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'vcpu_model' on Instance uuid cba49a3e-0ffe-4ea2-a956-bb41c178dd38 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRHCGBOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:11:34 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:11:34 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:11:34 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd652d65-3467-455f-8798-667aaf872edd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:11:34 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e77fe32-f00d-460a-a475-0b7978a221ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e] added
Jul 25 10:11:34 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68c546a-831c-4dda-8bfe-0185463b00f0]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c21068-43cc-4036-b6c6-e63be8dfe2f3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bRHCGBOA {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bRHCGBOA" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4526566f-b45c-486c-be1d-4ff1ab55c90d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bRHCGBOA'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[368d1d73-6d57-46e3-9192-1c2ceeea35c5]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde21e1d-162d-405a-b6d7-b3ccf1d23ceb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:11:34 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:11:34 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b03db76-b83c-443b-a08a-ef5fdf5d2540]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260]
Jul 25 10:11:34 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260] successful.
Jul 25 10:11:34 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d48acf6-fbbf-438e-89a4-b5031b351b2e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5279d9c-e3c8-4d82-b3d3-91c311108fa9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:11:34 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:11:34 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:11:34 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:11:34 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[efedb67c-a26d-491c-9cb2-e20f1c94b310]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRHCGBOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23466653362353862', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466653362353862', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-87945462',display_name='tempest-ServerActionsTestOtherA-server-87945462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-87945462',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7/PiN27E1zNONLGfU75gjTzl6TjLJTSPguo/w/NLGiNWvcFBQAXJk/RsZr2x3/TDzaN8UL9NG26qh75+qbwT35akc6FqjZaWZn3poJMiar+SGmPPXZDxAQP/CqYmNQIw==',key_name='tempest-keypair-2143034637',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c30d33a1a8945fdab6798c94a558444',ramdisk_id='',reservation_id='r-emt2yer0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-408585031',owner_user_name='tempest-ServerActionsTestOtherA-408585031-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:11:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfdced66e34e0ba7f9437e71aaee6a',uuid=cba49a3e-0ffe-4ea2-a956-bb41c178dd38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-930793975-network", "vif_mac": "fa:16:3e:39:2e:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converting VIF {"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-930793975-network", "vif_mac": "fa:16:3e:39:2e:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2e:f4,bridge_name='br-int',has_traffic_filtering=True,id=7e6bcfd4-3491-4be2-819d-92ed4bed42f7,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6bcfd4-34') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:11:35 user nova-compute[71312]:   <uuid>cba49a3e-0ffe-4ea2-a956-bb41c178dd38</uuid>
Jul 25 10:11:35 user nova-compute[71312]:   <name>instance-00000016</name>
Jul 25 10:11:35 user nova-compute[71312]:   <memory>2097152</memory>
Jul 25 10:11:35 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:11:35 user nova-compute[71312]:   <metadata>
Jul 25 10:11:35 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:11:35 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:11:35 user nova-compute[71312]:       <nova:name>tempest-ServerActionsTestOtherA-server-87945462</nova:name>
Jul 25 10:11:35 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:11:34</nova:creationTime>
Jul 25 10:11:35 user nova-compute[71312]:       <nova:flavor name="m1.small">
Jul 25 10:11:35 user nova-compute[71312]:         <nova:memory>2048</nova:memory>
Jul 25 10:11:35 user nova-compute[71312]:         <nova:disk>20</nova:disk>
Jul 25 10:11:35 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:11:35 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:11:35 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:11:35 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:11:35 user nova-compute[71312]:       <nova:owner>
Jul 25 10:11:35 user nova-compute[71312]:         <nova:user uuid="c2cfdced66e34e0ba7f9437e71aaee6a">tempest-ServerActionsTestOtherA-408585031-project-member</nova:user>
Jul 25 10:11:35 user nova-compute[71312]:         <nova:project uuid="9c30d33a1a8945fdab6798c94a558444">tempest-ServerActionsTestOtherA-408585031</nova:project>
Jul 25 10:11:35 user nova-compute[71312]:       </nova:owner>
Jul 25 10:11:35 user nova-compute[71312]:       <nova:ports>
Jul 25 10:11:35 user nova-compute[71312]:         <nova:port uuid="7e6bcfd4-3491-4be2-819d-92ed4bed42f7">
Jul 25 10:11:35 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:11:35 user nova-compute[71312]:         </nova:port>
Jul 25 10:11:35 user nova-compute[71312]:       </nova:ports>
Jul 25 10:11:35 user nova-compute[71312]:     </nova:instance>
Jul 25 10:11:35 user nova-compute[71312]:   </metadata>
Jul 25 10:11:35 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:11:35 user nova-compute[71312]:     <system>
Jul 25 10:11:35 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:11:35 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:11:35 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:11:35 user nova-compute[71312]:       <entry name="serial">cba49a3e-0ffe-4ea2-a956-bb41c178dd38</entry>
Jul 25 10:11:35 user nova-compute[71312]:       <entry name="uuid">cba49a3e-0ffe-4ea2-a956-bb41c178dd38</entry>
Jul 25 10:11:35 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:11:35 user nova-compute[71312]:     </system>
Jul 25 10:11:35 user nova-compute[71312]:   </sysinfo>
Jul 25 10:11:35 user nova-compute[71312]:   <os>
Jul 25 10:11:35 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:11:35 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:11:35 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:11:35 user nova-compute[71312]:   </os>
Jul 25 10:11:35 user nova-compute[71312]:   <features>
Jul 25 10:11:35 user nova-compute[71312]:     <acpi/>
Jul 25 10:11:35 user nova-compute[71312]:     <apic/>
Jul 25 10:11:35 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:11:35 user nova-compute[71312]:   </features>
Jul 25 10:11:35 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:11:35 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:11:35 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:11:35 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:11:35 user nova-compute[71312]:   </clock>
Jul 25 10:11:35 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:11:35 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:11:35 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:11:35 user nova-compute[71312]:   </cpu>
Jul 25 10:11:35 user nova-compute[71312]:   <devices>
Jul 25 10:11:35 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:11:35 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:11:35 user nova-compute[71312]:       <source dev="/dev/sdc"/>
Jul 25 10:11:35 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:11:35 user nova-compute[71312]:       <serial>81927262-7d9a-4a7e-b71b-c0508ba11c5e</serial>
Jul 25 10:11:35 user nova-compute[71312]:     </disk>
Jul 25 10:11:35 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:11:35 user nova-compute[71312]:       <mac address="fa:16:3e:39:2e:f4"/>
Jul 25 10:11:35 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:11:35 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:11:35 user nova-compute[71312]:       <target dev="tap7e6bcfd4-34"/>
Jul 25 10:11:35 user nova-compute[71312]:     </interface>
Jul 25 10:11:35 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:11:35 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/cba49a3e-0ffe-4ea2-a956-bb41c178dd38/console.log" append="off"/>
Jul 25 10:11:35 user nova-compute[71312]:     </serial>
Jul 25 10:11:35 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:11:35 user nova-compute[71312]:     <video>
Jul 25 10:11:35 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:11:35 user nova-compute[71312]:     </video>
Jul 25 10:11:35 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:11:35 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:11:35 user nova-compute[71312]:     </rng>
Jul 25 10:11:35 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:11:35 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:11:35 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:11:35 user nova-compute[71312]:     </memballoon>
Jul 25 10:11:35 user nova-compute[71312]:   </devices>
Jul 25 10:11:35 user nova-compute[71312]: </domain>
Jul 25 10:11:35 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-87945462',display_name='tempest-ServerActionsTestOtherA-server-87945462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-87945462',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7/PiN27E1zNONLGfU75gjTzl6TjLJTSPguo/w/NLGiNWvcFBQAXJk/RsZr2x3/TDzaN8UL9NG26qh75+qbwT35akc6FqjZaWZn3poJMiar+SGmPPXZDxAQP/CqYmNQIw==',key_name='tempest-keypair-2143034637',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c30d33a1a8945fdab6798c94a558444',ramdisk_id='',reservation_id='r-emt2yer0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-408585031',owner_user_name='tempest-ServerActionsTestOtherA-408585031-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:11:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfdced66e34e0ba7f9437e71aaee6a',uuid=cba49a3e-0ffe-4ea2-a956-bb41c178dd38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-930793975-network", "vif_mac": "fa:16:3e:39:2e:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converting VIF {"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-930793975-network", "vif_mac": "fa:16:3e:39:2e:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2e:f4,bridge_name='br-int',has_traffic_filtering=True,id=7e6bcfd4-3491-4be2-819d-92ed4bed42f7,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6bcfd4-34') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG os_vif [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2e:f4,bridge_name='br-int',has_traffic_filtering=True,id=7e6bcfd4-3491-4be2-819d-92ed4bed42f7,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6bcfd4-34') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e6bcfd4-34, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e6bcfd4-34, col_values=(('external_ids', {'iface-id': '7e6bcfd4-3491-4be2-819d-92ed4bed42f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:2e:f4', 'vm-uuid': 'cba49a3e-0ffe-4ea2-a956-bb41c178dd38'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:35 user nova-compute[71312]: INFO os_vif [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2e:f4,bridge_name='br-int',has_traffic_filtering=True,id=7e6bcfd4-3491-4be2-819d-92ed4bed42f7,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6bcfd4-34')
Jul 25 10:11:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:11:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] No VIF found with MAC fa:16:3e:39:2e:f4, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279896.252749, 59f4ee46-2dcc-4609-99a2-d3260be757f3 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:11:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] VM Resumed (Lifecycle Event)
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:11:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Instance spawned successfully.
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279896.2537348, 59f4ee46-2dcc-4609-99a2-d3260be757f3 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:11:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] VM Started (Lifecycle Event)
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-5cd9d8a9-0a90-41fb-92f6-32eb70f12503 req-39509cf3-19c1-43f4-bcf3-51c2fc1d3e14 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Received event network-vif-plugged-9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cd9d8a9-0a90-41fb-92f6-32eb70f12503 req-39509cf3-19c1-43f4-bcf3-51c2fc1d3e14 service nova] Acquiring lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cd9d8a9-0a90-41fb-92f6-32eb70f12503 req-39509cf3-19c1-43f4-bcf3-51c2fc1d3e14 service nova] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cd9d8a9-0a90-41fb-92f6-32eb70f12503 req-39509cf3-19c1-43f4-bcf3-51c2fc1d3e14 service nova] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-5cd9d8a9-0a90-41fb-92f6-32eb70f12503 req-39509cf3-19c1-43f4-bcf3-51c2fc1d3e14 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] No waiting events found dispatching network-vif-plugged-9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:36 user nova-compute[71312]: WARNING nova.compute.manager [req-5cd9d8a9-0a90-41fb-92f6-32eb70f12503 req-39509cf3-19c1-43f4-bcf3-51c2fc1d3e14 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Received unexpected event network-vif-plugged-9064e662-791e-46c5-b2e4-4f849ebba931 for instance with vm_state building and task_state spawning.
Jul 25 10:11:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:11:36 user nova-compute[71312]: INFO nova.compute.manager [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Took 8.06 seconds to spawn the instance on the hypervisor.
Jul 25 10:11:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:36 user nova-compute[71312]: INFO nova.compute.manager [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Took 9.16 seconds to build instance.
Jul 25 10:11:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3fafb715-1765-4713-81fa-d190801c4bad tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.462s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-d15cd7d7-95a5-4c13-baa1-53e658c42e9d req-cb93d998-596f-4016-ae56-e352728db74e service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received event network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d15cd7d7-95a5-4c13-baa1-53e658c42e9d req-cb93d998-596f-4016-ae56-e352728db74e service nova] Acquiring lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d15cd7d7-95a5-4c13-baa1-53e658c42e9d req-cb93d998-596f-4016-ae56-e352728db74e service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d15cd7d7-95a5-4c13-baa1-53e658c42e9d req-cb93d998-596f-4016-ae56-e352728db74e service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-d15cd7d7-95a5-4c13-baa1-53e658c42e9d req-cb93d998-596f-4016-ae56-e352728db74e service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] No waiting events found dispatching network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:38 user nova-compute[71312]: WARNING nova.compute.manager [req-d15cd7d7-95a5-4c13-baa1-53e658c42e9d req-cb93d998-596f-4016-ae56-e352728db74e service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received unexpected event network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 for instance with vm_state active and task_state resize_finish.
Jul 25 10:11:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-d15cd7d7-95a5-4c13-baa1-53e658c42e9d req-cb93d998-596f-4016-ae56-e352728db74e service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received event network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d15cd7d7-95a5-4c13-baa1-53e658c42e9d req-cb93d998-596f-4016-ae56-e352728db74e service nova] Acquiring lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d15cd7d7-95a5-4c13-baa1-53e658c42e9d req-cb93d998-596f-4016-ae56-e352728db74e service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d15cd7d7-95a5-4c13-baa1-53e658c42e9d req-cb93d998-596f-4016-ae56-e352728db74e service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-d15cd7d7-95a5-4c13-baa1-53e658c42e9d req-cb93d998-596f-4016-ae56-e352728db74e service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] No waiting events found dispatching network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:38 user nova-compute[71312]: WARNING nova.compute.manager [req-d15cd7d7-95a5-4c13-baa1-53e658c42e9d req-cb93d998-596f-4016-ae56-e352728db74e service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received unexpected event network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 for instance with vm_state active and task_state resize_finish.
Jul 25 10:11:39 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279884.1488273, cba49a3e-0ffe-4ea2-a956-bb41c178dd38 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:11:39 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] VM Stopped (Lifecycle Event)
Jul 25 10:11:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9a7ad0b0-f84e-4112-9a3a-5e1051c6bf41 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:39 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279899.515135, cba49a3e-0ffe-4ea2-a956-bb41c178dd38 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:11:39 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] VM Resumed (Lifecycle Event)
Jul 25 10:11:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:11:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Instance running successfully.
Jul 25 10:11:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Failed to set time: agent not configured {{(pid=71312) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 25 10:11:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ff012816-15c8-4e45-a6c9-5689d23a6123 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] finish_migration finished successfully. {{(pid=71312) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 25 10:11:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:11:39 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 25 10:11:39 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279899.5193942, cba49a3e-0ffe-4ea2-a956-bb41c178dd38 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:11:39 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] VM Started (Lifecycle Event)
Jul 25 10:11:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:11:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:39 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 25 10:11:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:11:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:11:42 user nova-compute[71312]: INFO nova.compute.claims [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Claim successful on node user
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.network.neutron [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:11:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.policy [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3597b22f53c54e5ab63730caefea2369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2222bf62bf487c911c811dbd8df8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:11:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Creating image(s)
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "/opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "/opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk 1073741824" returned: 0 in 0.054s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.network.neutron [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Successfully created port: c26e10b5-2f15-45c8-9745-5556b19709a7 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Cannot resize image /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lazy-loading 'migration_context' on Instance uuid f5aa6ae1-551a-4f51-a29f-14612f9b17e6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Ensure instance console log exists: /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:44 user nova-compute[71312]: INFO nova.compute.manager [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Terminating instance
Jul 25 10:11:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG nova.network.neutron [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Successfully updated port: c26e10b5-2f15-45c8-9745-5556b19709a7 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "refresh_cache-f5aa6ae1-551a-4f51-a29f-14612f9b17e6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquired lock "refresh_cache-f5aa6ae1-551a-4f51-a29f-14612f9b17e6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG nova.network.neutron [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-4d024ebd-9251-4d34-b544-3662f44dc734 req-2b8b37fb-22ae-4077-ba92-4f57b41c274d service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Received event network-changed-c26e10b5-2f15-45c8-9745-5556b19709a7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-4d024ebd-9251-4d34-b544-3662f44dc734 req-2b8b37fb-22ae-4077-ba92-4f57b41c274d service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Refreshing instance network info cache due to event network-changed-c26e10b5-2f15-45c8-9745-5556b19709a7. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4d024ebd-9251-4d34-b544-3662f44dc734 req-2b8b37fb-22ae-4077-ba92-4f57b41c274d service nova] Acquiring lock "refresh_cache-f5aa6ae1-551a-4f51-a29f-14612f9b17e6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG nova.network.neutron [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-c2b6e773-b4ff-42d5-bd16-028f9316caf2 req-d60de8bf-e43a-44a1-95ee-1218238c15a6 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-vif-unplugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c2b6e773-b4ff-42d5-bd16-028f9316caf2 req-d60de8bf-e43a-44a1-95ee-1218238c15a6 service nova] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c2b6e773-b4ff-42d5-bd16-028f9316caf2 req-d60de8bf-e43a-44a1-95ee-1218238c15a6 service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c2b6e773-b4ff-42d5-bd16-028f9316caf2 req-d60de8bf-e43a-44a1-95ee-1218238c15a6 service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-c2b6e773-b4ff-42d5-bd16-028f9316caf2 req-d60de8bf-e43a-44a1-95ee-1218238c15a6 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] No waiting events found dispatching network-vif-unplugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-c2b6e773-b4ff-42d5-bd16-028f9316caf2 req-d60de8bf-e43a-44a1-95ee-1218238c15a6 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-vif-unplugged-bd177392-3e41-4cbf-b629-68a33265fae2 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Updating instance_info_cache with network_info: [{"id": "c26e10b5-2f15-45c8-9745-5556b19709a7", "address": "fa:16:3e:e3:1b:7d", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26e10b5-2f", "ovs_interfaceid": "c26e10b5-2f15-45c8-9745-5556b19709a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Releasing lock "refresh_cache-f5aa6ae1-551a-4f51-a29f-14612f9b17e6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Instance network_info: |[{"id": "c26e10b5-2f15-45c8-9745-5556b19709a7", "address": "fa:16:3e:e3:1b:7d", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26e10b5-2f", "ovs_interfaceid": "c26e10b5-2f15-45c8-9745-5556b19709a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4d024ebd-9251-4d34-b544-3662f44dc734 req-2b8b37fb-22ae-4077-ba92-4f57b41c274d service nova] Acquired lock "refresh_cache-f5aa6ae1-551a-4f51-a29f-14612f9b17e6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.network.neutron [req-4d024ebd-9251-4d34-b544-3662f44dc734 req-2b8b37fb-22ae-4077-ba92-4f57b41c274d service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Refreshing network info cache for port c26e10b5-2f15-45c8-9745-5556b19709a7 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Start _get_guest_xml network_info=[{"id": "c26e10b5-2f15-45c8-9745-5556b19709a7", "address": "fa:16:3e:e3:1b:7d", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26e10b5-2f", "ovs_interfaceid": "c26e10b5-2f15-45c8-9745-5556b19709a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:11:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Instance destroyed successfully.
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'resources' on Instance uuid 9be175c2-20a4-45ce-85a7-ee3c406a4b1f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1905762448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1905762448',id=17,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvKvs8yd/NCFKkUWvMqLOY4/x6Uz25yC2jkPkcm7758dTAqRpS9uCldsrdCsLRvuo94l2rgvDVdbsWq2Cxuin+cxVAQKbFF3fhDUMd0Ge/4O05oIjQjwaOTBjiXtrVtEA==',key_name='tempest-keypair-909376568',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:09:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23211f867d6049f5bb1901e03e8dc396',ramdisk_id='',reservation_id='r-ker0w51i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1954806993',owner_user_name='tempest-AttachVolumeShelveTestJSON-1954806993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:09:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec3ee9c206b43448eb6479cad0b437c',uuid=9be175c2-20a4-45ce-85a7-ee3c406a4b1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converting VIF {"id": "bd177392-3e41-4cbf-b629-68a33265fae2", "address": "fa:16:3e:b0:de:ac", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd177392-3e", "ovs_interfaceid": "bd177392-3e41-4cbf-b629-68a33265fae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:de:ac,bridge_name='br-int',has_traffic_filtering=True,id=bd177392-3e41-4cbf-b629-68a33265fae2,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd177392-3e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG os_vif [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:de:ac,bridge_name='br-int',has_traffic_filtering=True,id=bd177392-3e41-4cbf-b629-68a33265fae2,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd177392-3e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd177392-3e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:45 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:11:45 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:11:45 user nova-compute[71312]: INFO os_vif [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:de:ac,bridge_name='br-int',has_traffic_filtering=True,id=bd177392-3e41-4cbf-b629-68a33265fae2,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd177392-3e')
Jul 25 10:11:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Deleting instance files /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f_del
Jul 25 10:11:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Deletion of /opt/stack/data/nova/instances/9be175c2-20a4-45ce-85a7-ee3c406a4b1f_del complete
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:11:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2012189606',display_name='tempest-ServersNegativeTestJSON-server-2012189606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2012189606',id=27,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e2222bf62bf487c911c811dbd8df8f1',ramdisk_id='',reservation_id='r-5w31bnk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-404227801',owner_user_name='tempest-ServersNegativeTestJSON-404227801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:11:43Z,user_data=None,user_id='3597b22f53c54e5ab63730caefea2369',uuid=f5aa6ae1-551a-4f51-a29f-14612f9b17e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c26e10b5-2f15-45c8-9745-5556b19709a7", "address": "fa:16:3e:e3:1b:7d", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26e10b5-2f", "ovs_interfaceid": "c26e10b5-2f15-45c8-9745-5556b19709a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Converting VIF {"id": "c26e10b5-2f15-45c8-9745-5556b19709a7", "address": "fa:16:3e:e3:1b:7d", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26e10b5-2f", "ovs_interfaceid": "c26e10b5-2f15-45c8-9745-5556b19709a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:1b:7d,bridge_name='br-int',has_traffic_filtering=True,id=c26e10b5-2f15-45c8-9745-5556b19709a7,network=Network(44edfeb7-92a1-4284-ae77-c7d1e351aa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26e10b5-2f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.objects.instance [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lazy-loading 'pci_devices' on Instance uuid f5aa6ae1-551a-4f51-a29f-14612f9b17e6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:11:45 user nova-compute[71312]:   <uuid>f5aa6ae1-551a-4f51-a29f-14612f9b17e6</uuid>
Jul 25 10:11:45 user nova-compute[71312]:   <name>instance-0000001b</name>
Jul 25 10:11:45 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:11:45 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:11:45 user nova-compute[71312]:   <metadata>
Jul 25 10:11:45 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:11:45 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:11:45 user nova-compute[71312]:       <nova:name>tempest-ServersNegativeTestJSON-server-2012189606</nova:name>
Jul 25 10:11:45 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:11:45</nova:creationTime>
Jul 25 10:11:45 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:11:45 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:11:45 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:11:45 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:11:45 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:11:45 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:11:45 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:11:45 user nova-compute[71312]:       <nova:owner>
Jul 25 10:11:45 user nova-compute[71312]:         <nova:user uuid="3597b22f53c54e5ab63730caefea2369">tempest-ServersNegativeTestJSON-404227801-project-member</nova:user>
Jul 25 10:11:45 user nova-compute[71312]:         <nova:project uuid="1e2222bf62bf487c911c811dbd8df8f1">tempest-ServersNegativeTestJSON-404227801</nova:project>
Jul 25 10:11:45 user nova-compute[71312]:       </nova:owner>
Jul 25 10:11:45 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:11:45 user nova-compute[71312]:       <nova:ports>
Jul 25 10:11:45 user nova-compute[71312]:         <nova:port uuid="c26e10b5-2f15-45c8-9745-5556b19709a7">
Jul 25 10:11:45 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 10:11:45 user nova-compute[71312]:         </nova:port>
Jul 25 10:11:45 user nova-compute[71312]:       </nova:ports>
Jul 25 10:11:45 user nova-compute[71312]:     </nova:instance>
Jul 25 10:11:45 user nova-compute[71312]:   </metadata>
Jul 25 10:11:45 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:11:45 user nova-compute[71312]:     <system>
Jul 25 10:11:45 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:11:45 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:11:45 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:11:45 user nova-compute[71312]:       <entry name="serial">f5aa6ae1-551a-4f51-a29f-14612f9b17e6</entry>
Jul 25 10:11:45 user nova-compute[71312]:       <entry name="uuid">f5aa6ae1-551a-4f51-a29f-14612f9b17e6</entry>
Jul 25 10:11:45 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:11:45 user nova-compute[71312]:     </system>
Jul 25 10:11:45 user nova-compute[71312]:   </sysinfo>
Jul 25 10:11:45 user nova-compute[71312]:   <os>
Jul 25 10:11:45 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:11:45 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:11:45 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:11:45 user nova-compute[71312]:   </os>
Jul 25 10:11:45 user nova-compute[71312]:   <features>
Jul 25 10:11:45 user nova-compute[71312]:     <acpi/>
Jul 25 10:11:45 user nova-compute[71312]:     <apic/>
Jul 25 10:11:45 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:11:45 user nova-compute[71312]:   </features>
Jul 25 10:11:45 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:11:45 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:11:45 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:11:45 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:11:45 user nova-compute[71312]:   </clock>
Jul 25 10:11:45 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:11:45 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:11:45 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:11:45 user nova-compute[71312]:   </cpu>
Jul 25 10:11:45 user nova-compute[71312]:   <devices>
Jul 25 10:11:45 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:11:45 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:11:45 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk"/>
Jul 25 10:11:45 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:11:45 user nova-compute[71312]:     </disk>
Jul 25 10:11:45 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:11:45 user nova-compute[71312]:       <mac address="fa:16:3e:e3:1b:7d"/>
Jul 25 10:11:45 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:11:45 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:11:45 user nova-compute[71312]:       <target dev="tapc26e10b5-2f"/>
Jul 25 10:11:45 user nova-compute[71312]:     </interface>
Jul 25 10:11:45 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:11:45 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/console.log" append="off"/>
Jul 25 10:11:45 user nova-compute[71312]:     </serial>
Jul 25 10:11:45 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:11:45 user nova-compute[71312]:     <video>
Jul 25 10:11:45 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:11:45 user nova-compute[71312]:     </video>
Jul 25 10:11:45 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:11:45 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:11:45 user nova-compute[71312]:     </rng>
Jul 25 10:11:45 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:11:45 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:11:45 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:11:45 user nova-compute[71312]:     </memballoon>
Jul 25 10:11:45 user nova-compute[71312]:   </devices>
Jul 25 10:11:45 user nova-compute[71312]: </domain>
Jul 25 10:11:45 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:11:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2012189606',display_name='tempest-ServersNegativeTestJSON-server-2012189606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2012189606',id=27,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e2222bf62bf487c911c811dbd8df8f1',ramdisk_id='',reservation_id='r-5w31bnk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-404227801',owner_user_name='tempest-ServersNegativeTestJSON-404227801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:11:43Z,user_data=None,user_id='3597b22f53c54e5ab63730caefea2369',uuid=f5aa6ae1-551a-4f51-a29f-14612f9b17e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c26e10b5-2f15-45c8-9745-5556b19709a7", "address": "fa:16:3e:e3:1b:7d", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26e10b5-2f", "ovs_interfaceid": "c26e10b5-2f15-45c8-9745-5556b19709a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Converting VIF {"id": "c26e10b5-2f15-45c8-9745-5556b19709a7", "address": "fa:16:3e:e3:1b:7d", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26e10b5-2f", "ovs_interfaceid": "c26e10b5-2f15-45c8-9745-5556b19709a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:1b:7d,bridge_name='br-int',has_traffic_filtering=True,id=c26e10b5-2f15-45c8-9745-5556b19709a7,network=Network(44edfeb7-92a1-4284-ae77-c7d1e351aa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26e10b5-2f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG os_vif [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:1b:7d,bridge_name='br-int',has_traffic_filtering=True,id=c26e10b5-2f15-45c8-9745-5556b19709a7,network=Network(44edfeb7-92a1-4284-ae77-c7d1e351aa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26e10b5-2f') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc26e10b5-2f, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc26e10b5-2f, col_values=(('external_ids', {'iface-id': 'c26e10b5-2f15-45c8-9745-5556b19709a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:1b:7d', 'vm-uuid': 'f5aa6ae1-551a-4f51-a29f-14612f9b17e6'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:11:45 user nova-compute[71312]: INFO nova.compute.manager [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 25 10:11:45 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:11:45 user nova-compute[71312]: INFO os_vif [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:1b:7d,bridge_name='br-int',has_traffic_filtering=True,id=c26e10b5-2f15-45c8-9745-5556b19709a7,network=Network(44edfeb7-92a1-4284-ae77-c7d1e351aa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26e10b5-2f')
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] No VIF found with MAC fa:16:3e:e3:1b:7d, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.network.neutron [req-4d024ebd-9251-4d34-b544-3662f44dc734 req-2b8b37fb-22ae-4077-ba92-4f57b41c274d service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Updated VIF entry in instance network info cache for port c26e10b5-2f15-45c8-9745-5556b19709a7. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG nova.network.neutron [req-4d024ebd-9251-4d34-b544-3662f44dc734 req-2b8b37fb-22ae-4077-ba92-4f57b41c274d service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Updating instance_info_cache with network_info: [{"id": "c26e10b5-2f15-45c8-9745-5556b19709a7", "address": "fa:16:3e:e3:1b:7d", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26e10b5-2f", "ovs_interfaceid": "c26e10b5-2f15-45c8-9745-5556b19709a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4d024ebd-9251-4d34-b544-3662f44dc734 req-2b8b37fb-22ae-4077-ba92-4f57b41c274d service nova] Releasing lock "refresh_cache-f5aa6ae1-551a-4f51-a29f-14612f9b17e6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:11:46 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:11:46 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Took 0.98 seconds to deallocate network for instance.
Jul 25 10:11:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:46 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:11:46 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:11:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-c459d05c-1f57-4ec7-87d9-adfbb58522fe req-0b12ec37-e291-44ff-8f2f-6180024be293 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c459d05c-1f57-4ec7-87d9-adfbb58522fe req-0b12ec37-e291-44ff-8f2f-6180024be293 service nova] Acquiring lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c459d05c-1f57-4ec7-87d9-adfbb58522fe req-0b12ec37-e291-44ff-8f2f-6180024be293 service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c459d05c-1f57-4ec7-87d9-adfbb58522fe req-0b12ec37-e291-44ff-8f2f-6180024be293 service nova] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-c459d05c-1f57-4ec7-87d9-adfbb58522fe req-0b12ec37-e291-44ff-8f2f-6180024be293 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] No waiting events found dispatching network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:46 user nova-compute[71312]: WARNING nova.compute.manager [req-c459d05c-1f57-4ec7-87d9-adfbb58522fe req-0b12ec37-e291-44ff-8f2f-6180024be293 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received unexpected event network-vif-plugged-bd177392-3e41-4cbf-b629-68a33265fae2 for instance with vm_state deleted and task_state None.
Jul 25 10:11:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-c459d05c-1f57-4ec7-87d9-adfbb58522fe req-0b12ec37-e291-44ff-8f2f-6180024be293 service nova] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Received event network-vif-deleted-bd177392-3e41-4cbf-b629-68a33265fae2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:46 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Deleted allocations for instance 9be175c2-20a4-45ce-85a7-ee3c406a4b1f
Jul 25 10:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6663a4d1-e9a4-467b-8182-944f716de639 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "9be175c2-20a4-45ce-85a7-ee3c406a4b1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.653s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-eb5f05a8-8304-44ae-b8e9-b8954e333ba5 req-6f0c80f2-b1ac-4d7e-a8ec-f9fb1ef70e17 service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Received event network-vif-plugged-c26e10b5-2f15-45c8-9745-5556b19709a7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eb5f05a8-8304-44ae-b8e9-b8954e333ba5 req-6f0c80f2-b1ac-4d7e-a8ec-f9fb1ef70e17 service nova] Acquiring lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eb5f05a8-8304-44ae-b8e9-b8954e333ba5 req-6f0c80f2-b1ac-4d7e-a8ec-f9fb1ef70e17 service nova] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eb5f05a8-8304-44ae-b8e9-b8954e333ba5 req-6f0c80f2-b1ac-4d7e-a8ec-f9fb1ef70e17 service nova] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-eb5f05a8-8304-44ae-b8e9-b8954e333ba5 req-6f0c80f2-b1ac-4d7e-a8ec-f9fb1ef70e17 service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] No waiting events found dispatching network-vif-plugged-c26e10b5-2f15-45c8-9745-5556b19709a7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:47 user nova-compute[71312]: WARNING nova.compute.manager [req-eb5f05a8-8304-44ae-b8e9-b8954e333ba5 req-6f0c80f2-b1ac-4d7e-a8ec-f9fb1ef70e17 service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Received unexpected event network-vif-plugged-c26e10b5-2f15-45c8-9745-5556b19709a7 for instance with vm_state building and task_state spawning.
Jul 25 10:11:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279909.0508275, f5aa6ae1-551a-4f51-a29f-14612f9b17e6 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:11:49 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] VM Resumed (Lifecycle Event)
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:11:49 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Instance spawned successfully.
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:11:49 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279909.0521498, f5aa6ae1-551a-4f51-a29f-14612f9b17e6 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:11:49 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] VM Started (Lifecycle Event)
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:11:49 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:11:49 user nova-compute[71312]: INFO nova.compute.manager [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Took 5.88 seconds to spawn the instance on the hypervisor.
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:11:49 user nova-compute[71312]: INFO nova.compute.manager [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Took 6.65 seconds to build instance.
Jul 25 10:11:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af02e9dc-54f9-4ead-82e7-77f661c065d4 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.744s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-5e01b50c-9220-4dfc-9801-4c8e975d1415 req-c801d623-e093-4df1-b45f-b3c7c6603eb0 service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Received event network-vif-plugged-c26e10b5-2f15-45c8-9745-5556b19709a7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5e01b50c-9220-4dfc-9801-4c8e975d1415 req-c801d623-e093-4df1-b45f-b3c7c6603eb0 service nova] Acquiring lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5e01b50c-9220-4dfc-9801-4c8e975d1415 req-c801d623-e093-4df1-b45f-b3c7c6603eb0 service nova] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5e01b50c-9220-4dfc-9801-4c8e975d1415 req-c801d623-e093-4df1-b45f-b3c7c6603eb0 service nova] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:11:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-5e01b50c-9220-4dfc-9801-4c8e975d1415 req-c801d623-e093-4df1-b45f-b3c7c6603eb0 service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] No waiting events found dispatching network-vif-plugged-c26e10b5-2f15-45c8-9745-5556b19709a7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:11:49 user nova-compute[71312]: WARNING nova.compute.manager [req-5e01b50c-9220-4dfc-9801-4c8e975d1415 req-c801d623-e093-4df1-b45f-b3c7c6603eb0 service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Received unexpected event network-vif-plugged-c26e10b5-2f15-45c8-9745-5556b19709a7 for instance with vm_state active and task_state None.
Jul 25 10:11:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:11:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:00 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690279905.2126677, 9be175c2-20a4-45ce-85a7-ee3c406a4b1f => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:12:00 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] VM Stopped (Lifecycle Event)
Jul 25 10:12:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9b0d420f-8f82-4327-ad39-44a1b7ad750d None None] [instance: 9be175c2-20a4-45ce-85a7-ee3c406a4b1f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:12:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:12:04 user nova-compute[71312]: INFO nova.compute.claims [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Claim successful on node user
Jul 25 10:12:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:04 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:12:04 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:12:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:12:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:12:04 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:12:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:12:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:12:04 user nova-compute[71312]: INFO nova.virt.block_device [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Booting with volume-backed-image ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8 at /dev/vda
Jul 25 10:12:05 user nova-compute[71312]: DEBUG nova.policy [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96d25383d4b6448da2d30479a26bfa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14fcd7739f41eabc9e7120f5b58a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:12:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:05 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Successfully created port: 39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:12:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Successfully updated port: 39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:12:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "refresh_cache-b8e398f8-9e73-4077-a773-fdd1e494d37f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:12:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquired lock "refresh_cache-b8e398f8-9e73-4077-a773-fdd1e494d37f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:12:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:12:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:12:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-815765fb-52c5-44fe-9367-c34746f64772 req-0fd23249-2798-46bc-b9a5-96c938655144 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-changed-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:12:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-815765fb-52c5-44fe-9367-c34746f64772 req-0fd23249-2798-46bc-b9a5-96c938655144 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Refreshing instance network info cache due to event network-changed-39f60d81-9344-4fc4-917d-aa4dc290a5e0. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:12:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-815765fb-52c5-44fe-9367-c34746f64772 req-0fd23249-2798-46bc-b9a5-96c938655144 service nova] Acquiring lock "refresh_cache-b8e398f8-9e73-4077-a773-fdd1e494d37f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:12:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Updating instance_info_cache with network_info: [{"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:12:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Releasing lock "refresh_cache-b8e398f8-9e73-4077-a773-fdd1e494d37f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:12:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Instance network_info: |[{"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:12:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-815765fb-52c5-44fe-9367-c34746f64772 req-0fd23249-2798-46bc-b9a5-96c938655144 service nova] Acquired lock "refresh_cache-b8e398f8-9e73-4077-a773-fdd1e494d37f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:12:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-815765fb-52c5-44fe-9367-c34746f64772 req-0fd23249-2798-46bc-b9a5-96c938655144 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Refreshing network info cache for port 39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:12:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-815765fb-52c5-44fe-9367-c34746f64772 req-0fd23249-2798-46bc-b9a5-96c938655144 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Updated VIF entry in instance network info cache for port 39f60d81-9344-4fc4-917d-aa4dc290a5e0. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:12:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-815765fb-52c5-44fe-9367-c34746f64772 req-0fd23249-2798-46bc-b9a5-96c938655144 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Updating instance_info_cache with network_info: [{"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:12:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-815765fb-52c5-44fe-9367-c34746f64772 req-0fd23249-2798-46bc-b9a5-96c938655144 service nova] Releasing lock "refresh_cache-b8e398f8-9e73-4077-a773-fdd1e494d37f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:12:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "58a20181-bba3-43ad-bddc-a63abc7cf80a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "58a20181-bba3-43ad-bddc-a63abc7cf80a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:12:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:12:08 user nova-compute[71312]: INFO nova.compute.claims [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Claim successful on node user
Jul 25 10:12:08 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:12:08 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:12:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:12:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:12:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG nova.policy [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ca2145682dd42388f078b2236c2a196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43f656906af4f9e99608f46026618dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:12:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Creating image(s)
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "/opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "/opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "/opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.155s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk 1073741824" returned: 0 in 0.059s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Successfully created port: 494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Cannot resize image /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lazy-loading 'migration_context' on Instance uuid 58a20181-bba3-43ad-bddc-a63abc7cf80a {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Ensure instance console log exists: /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG os_brick.utils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Successfully updated port: 494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[83664b64-b71d-41cd-a995-5722a462fdfc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "refresh_cache-58a20181-bba3-43ad-bddc-a63abc7cf80a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquired lock "refresh_cache-58a20181-bba3-43ad-bddc-a63abc7cf80a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeb89d5-4c0a-44b3-8f9e-4d20915823ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-0ddfbed4-67db-4929-9310-ff530cab2ef1 req-6ea66550-109e-4e45-a2a8-5960c3436047 service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Received event network-changed-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-0ddfbed4-67db-4929-9310-ff530cab2ef1 req-6ea66550-109e-4e45-a2a8-5960c3436047 service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Refreshing instance network info cache due to event network-changed-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0ddfbed4-67db-4929-9310-ff530cab2ef1 req-6ea66550-109e-4e45-a2a8-5960c3436047 service nova] Acquiring lock "refresh_cache-58a20181-bba3-43ad-bddc-a63abc7cf80a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[df96ba12-1487-41ac-ba99-631b30372f19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f1a15b-ad03-4e3a-8797-bf6659bec259]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:12:10 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:12:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[72763906-7ae8-423f-a54e-211893bd9262]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG os_brick.utils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:12:10 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Updating existing volume attachment record: ae904e78-3da1-4d75-8929-34443caa14c3 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Updating instance_info_cache with network_info: [{"id": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "address": "fa:16:3e:09:12:99", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b9626-2d", "ovs_interfaceid": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Releasing lock "refresh_cache-58a20181-bba3-43ad-bddc-a63abc7cf80a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Instance network_info: |[{"id": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "address": "fa:16:3e:09:12:99", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b9626-2d", "ovs_interfaceid": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0ddfbed4-67db-4929-9310-ff530cab2ef1 req-6ea66550-109e-4e45-a2a8-5960c3436047 service nova] Acquired lock "refresh_cache-58a20181-bba3-43ad-bddc-a63abc7cf80a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-0ddfbed4-67db-4929-9310-ff530cab2ef1 req-6ea66550-109e-4e45-a2a8-5960c3436047 service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Refreshing network info cache for port 494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Start _get_guest_xml network_info=[{"id": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "address": "fa:16:3e:09:12:99", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b9626-2d", "ovs_interfaceid": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:12:11 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:12:11 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-397547476',display_name='tempest-VolumesActionsTest-instance-397547476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-397547476',id=29,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43f656906af4f9e99608f46026618dd',ramdisk_id='',reservation_id='r-ierq8b0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1049905673',owner_user_name='tempest-VolumesActionsTest-1049905673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:12:09Z,user_data=None,user_id='8ca2145682dd42388f078b2236c2a196',uuid=58a20181-bba3-43ad-bddc-a63abc7cf80a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "address": "fa:16:3e:09:12:99", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b9626-2d", "ovs_interfaceid": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Converting VIF {"id": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "address": "fa:16:3e:09:12:99", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b9626-2d", "ovs_interfaceid": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:12:99,bridge_name='br-int',has_traffic_filtering=True,id=494b9626-2d1f-4ebb-a254-9bf8ad5a55c2,network=Network(19db69ce-484c-42ca-932f-688f1da7f111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b9626-2d') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lazy-loading 'pci_devices' on Instance uuid 58a20181-bba3-43ad-bddc-a63abc7cf80a {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:12:11 user nova-compute[71312]:   <uuid>58a20181-bba3-43ad-bddc-a63abc7cf80a</uuid>
Jul 25 10:12:11 user nova-compute[71312]:   <name>instance-0000001d</name>
Jul 25 10:12:11 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:12:11 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:12:11 user nova-compute[71312]:   <metadata>
Jul 25 10:12:11 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:12:11 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:12:11 user nova-compute[71312]:       <nova:name>tempest-VolumesActionsTest-instance-397547476</nova:name>
Jul 25 10:12:11 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:12:11</nova:creationTime>
Jul 25 10:12:11 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:12:11 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:12:11 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:12:11 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:12:11 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:12:11 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:12:11 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:12:11 user nova-compute[71312]:       <nova:owner>
Jul 25 10:12:11 user nova-compute[71312]:         <nova:user uuid="8ca2145682dd42388f078b2236c2a196">tempest-VolumesActionsTest-1049905673-project-member</nova:user>
Jul 25 10:12:11 user nova-compute[71312]:         <nova:project uuid="b43f656906af4f9e99608f46026618dd">tempest-VolumesActionsTest-1049905673</nova:project>
Jul 25 10:12:11 user nova-compute[71312]:       </nova:owner>
Jul 25 10:12:11 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:12:11 user nova-compute[71312]:       <nova:ports>
Jul 25 10:12:11 user nova-compute[71312]:         <nova:port uuid="494b9626-2d1f-4ebb-a254-9bf8ad5a55c2">
Jul 25 10:12:11 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 10:12:11 user nova-compute[71312]:         </nova:port>
Jul 25 10:12:11 user nova-compute[71312]:       </nova:ports>
Jul 25 10:12:11 user nova-compute[71312]:     </nova:instance>
Jul 25 10:12:11 user nova-compute[71312]:   </metadata>
Jul 25 10:12:11 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:12:11 user nova-compute[71312]:     <system>
Jul 25 10:12:11 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:12:11 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:12:11 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:12:11 user nova-compute[71312]:       <entry name="serial">58a20181-bba3-43ad-bddc-a63abc7cf80a</entry>
Jul 25 10:12:11 user nova-compute[71312]:       <entry name="uuid">58a20181-bba3-43ad-bddc-a63abc7cf80a</entry>
Jul 25 10:12:11 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:12:11 user nova-compute[71312]:     </system>
Jul 25 10:12:11 user nova-compute[71312]:   </sysinfo>
Jul 25 10:12:11 user nova-compute[71312]:   <os>
Jul 25 10:12:11 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:12:11 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:12:11 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:12:11 user nova-compute[71312]:   </os>
Jul 25 10:12:11 user nova-compute[71312]:   <features>
Jul 25 10:12:11 user nova-compute[71312]:     <acpi/>
Jul 25 10:12:11 user nova-compute[71312]:     <apic/>
Jul 25 10:12:11 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:12:11 user nova-compute[71312]:   </features>
Jul 25 10:12:11 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:12:11 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:12:11 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:12:11 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:12:11 user nova-compute[71312]:   </clock>
Jul 25 10:12:11 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:12:11 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:12:11 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:12:11 user nova-compute[71312]:   </cpu>
Jul 25 10:12:11 user nova-compute[71312]:   <devices>
Jul 25 10:12:11 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:12:11 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:12:11 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk"/>
Jul 25 10:12:11 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:12:11 user nova-compute[71312]:     </disk>
Jul 25 10:12:11 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:12:11 user nova-compute[71312]:       <mac address="fa:16:3e:09:12:99"/>
Jul 25 10:12:11 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:12:11 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:12:11 user nova-compute[71312]:       <target dev="tap494b9626-2d"/>
Jul 25 10:12:11 user nova-compute[71312]:     </interface>
Jul 25 10:12:11 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:12:11 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/console.log" append="off"/>
Jul 25 10:12:11 user nova-compute[71312]:     </serial>
Jul 25 10:12:11 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:12:11 user nova-compute[71312]:     <video>
Jul 25 10:12:11 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:12:11 user nova-compute[71312]:     </video>
Jul 25 10:12:11 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:12:11 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:12:11 user nova-compute[71312]:     </rng>
Jul 25 10:12:11 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:12:11 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:12:11 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:12:11 user nova-compute[71312]:     </memballoon>
Jul 25 10:12:11 user nova-compute[71312]:   </devices>
Jul 25 10:12:11 user nova-compute[71312]: </domain>
Jul 25 10:12:11 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-397547476',display_name='tempest-VolumesActionsTest-instance-397547476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-397547476',id=29,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43f656906af4f9e99608f46026618dd',ramdisk_id='',reservation_id='r-ierq8b0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1049905673',owner_user_name='tempest-VolumesActionsTest-1049905673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:12:09Z,user_data=None,user_id='8ca2145682dd42388f078b2236c2a196',uuid=58a20181-bba3-43ad-bddc-a63abc7cf80a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "address": "fa:16:3e:09:12:99", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b9626-2d", "ovs_interfaceid": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Converting VIF {"id": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "address": "fa:16:3e:09:12:99", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b9626-2d", "ovs_interfaceid": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:12:99,bridge_name='br-int',has_traffic_filtering=True,id=494b9626-2d1f-4ebb-a254-9bf8ad5a55c2,network=Network(19db69ce-484c-42ca-932f-688f1da7f111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b9626-2d') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG os_vif [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:12:99,bridge_name='br-int',has_traffic_filtering=True,id=494b9626-2d1f-4ebb-a254-9bf8ad5a55c2,network=Network(19db69ce-484c-42ca-932f-688f1da7f111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b9626-2d') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap494b9626-2d, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap494b9626-2d, col_values=(('external_ids', {'iface-id': '494b9626-2d1f-4ebb-a254-9bf8ad5a55c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:12:99', 'vm-uuid': '58a20181-bba3-43ad-bddc-a63abc7cf80a'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:11 user nova-compute[71312]: INFO os_vif [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:12:99,bridge_name='br-int',has_traffic_filtering=True,id=494b9626-2d1f-4ebb-a254-9bf8ad5a55c2,network=Network(19db69ce-484c-42ca-932f-688f1da7f111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b9626-2d')
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] No VIF found with MAC fa:16:3e:09:12:99, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-0ddfbed4-67db-4929-9310-ff530cab2ef1 req-6ea66550-109e-4e45-a2a8-5960c3436047 service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Updated VIF entry in instance network info cache for port 494b9626-2d1f-4ebb-a254-9bf8ad5a55c2. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-0ddfbed4-67db-4929-9310-ff530cab2ef1 req-6ea66550-109e-4e45-a2a8-5960c3436047 service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Updating instance_info_cache with network_info: [{"id": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "address": "fa:16:3e:09:12:99", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b9626-2d", "ovs_interfaceid": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:12:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0ddfbed4-67db-4929-9310-ff530cab2ef1 req-6ea66550-109e-4e45-a2a8-5960c3436047 service nova] Releasing lock "refresh_cache-58a20181-bba3-43ad-bddc-a63abc7cf80a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:12:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e467de35-f36d-46b2-b793-3eac1e19d82f req-7ec8f7a0-172c-4601-87df-3342d3c57eef service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Received event network-vif-plugged-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:12:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e467de35-f36d-46b2-b793-3eac1e19d82f req-7ec8f7a0-172c-4601-87df-3342d3c57eef service nova] Acquiring lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e467de35-f36d-46b2-b793-3eac1e19d82f req-7ec8f7a0-172c-4601-87df-3342d3c57eef service nova] Lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e467de35-f36d-46b2-b793-3eac1e19d82f req-7ec8f7a0-172c-4601-87df-3342d3c57eef service nova] Lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e467de35-f36d-46b2-b793-3eac1e19d82f req-7ec8f7a0-172c-4601-87df-3342d3c57eef service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] No waiting events found dispatching network-vif-plugged-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:12:12 user nova-compute[71312]: WARNING nova.compute.manager [req-e467de35-f36d-46b2-b793-3eac1e19d82f req-7ec8f7a0-172c-4601-87df-3342d3c57eef service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Received unexpected event network-vif-plugged-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 for instance with vm_state building and task_state spawning.
Jul 25 10:12:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279934.7556329, 58a20181-bba3-43ad-bddc-a63abc7cf80a => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:12:14 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] VM Resumed (Lifecycle Event)
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:12:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Instance spawned successfully.
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:14 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279934.7621243, 58a20181-bba3-43ad-bddc-a63abc7cf80a => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:12:14 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] VM Started (Lifecycle Event)
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:12:14 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-94d543e6-b3da-4aa0-a3f9-ead6832893f2 req-369f430d-8de5-49d9-bc63-c77571d0cebb service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Received event network-vif-plugged-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-94d543e6-b3da-4aa0-a3f9-ead6832893f2 req-369f430d-8de5-49d9-bc63-c77571d0cebb service nova] Acquiring lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-94d543e6-b3da-4aa0-a3f9-ead6832893f2 req-369f430d-8de5-49d9-bc63-c77571d0cebb service nova] Lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-94d543e6-b3da-4aa0-a3f9-ead6832893f2 req-369f430d-8de5-49d9-bc63-c77571d0cebb service nova] Lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-94d543e6-b3da-4aa0-a3f9-ead6832893f2 req-369f430d-8de5-49d9-bc63-c77571d0cebb service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] No waiting events found dispatching network-vif-plugged-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:12:14 user nova-compute[71312]: WARNING nova.compute.manager [req-94d543e6-b3da-4aa0-a3f9-ead6832893f2 req-369f430d-8de5-49d9-bc63-c77571d0cebb service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Received unexpected event network-vif-plugged-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 for instance with vm_state building and task_state spawning.
Jul 25 10:12:14 user nova-compute[71312]: INFO nova.compute.manager [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Took 5.67 seconds to spawn the instance on the hypervisor.
Jul 25 10:12:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:12:14 user nova-compute[71312]: INFO nova.compute.manager [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Took 6.46 seconds to build instance.
Jul 25 10:12:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2f98376e-3053-46ca-bb64-bc68f606b2b7 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "58a20181-bba3-43ad-bddc-a63abc7cf80a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.607s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-27acc23b-0d06-4c05-9157-ffa2ee5cb93f req-43e24ac8-1cf6-4f7d-b055-00f3e492312e service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received event network-changed-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:12:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-27acc23b-0d06-4c05-9157-ffa2ee5cb93f req-43e24ac8-1cf6-4f7d-b055-00f3e492312e service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Refreshing instance network info cache due to event network-changed-8ff58b4d-cb02-4ba7-861d-086db41f3083. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:12:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-27acc23b-0d06-4c05-9157-ffa2ee5cb93f req-43e24ac8-1cf6-4f7d-b055-00f3e492312e service nova] Acquiring lock "refresh_cache-80e8cdf1-c86a-43aa-a66c-46af281187a5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:12:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-27acc23b-0d06-4c05-9157-ffa2ee5cb93f req-43e24ac8-1cf6-4f7d-b055-00f3e492312e service nova] Acquired lock "refresh_cache-80e8cdf1-c86a-43aa-a66c-46af281187a5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:12:15 user nova-compute[71312]: DEBUG nova.network.neutron [req-27acc23b-0d06-4c05-9157-ffa2ee5cb93f req-43e24ac8-1cf6-4f7d-b055-00f3e492312e service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Refreshing network info cache for port 8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:12:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:16 user nova-compute[71312]: DEBUG nova.network.neutron [req-27acc23b-0d06-4c05-9157-ffa2ee5cb93f req-43e24ac8-1cf6-4f7d-b055-00f3e492312e service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Updated VIF entry in instance network info cache for port 8ff58b4d-cb02-4ba7-861d-086db41f3083. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:12:16 user nova-compute[71312]: DEBUG nova.network.neutron [req-27acc23b-0d06-4c05-9157-ffa2ee5cb93f req-43e24ac8-1cf6-4f7d-b055-00f3e492312e service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Updating instance_info_cache with network_info: [{"id": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "address": "fa:16:3e:5c:c5:1c", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff58b4d-cb", "ovs_interfaceid": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:12:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-27acc23b-0d06-4c05-9157-ffa2ee5cb93f req-43e24ac8-1cf6-4f7d-b055-00f3e492312e service nova] Releasing lock "refresh_cache-80e8cdf1-c86a-43aa-a66c-46af281187a5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:12:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Creating image(s)
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Ensure instance console log exists: /opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Start _get_guest_xml network_info=[{"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'ae904e78-3da1-4d75-8929-34443caa14c3', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXVkBRZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8e398f8-9e73-4077-a773-fdd1e494d37f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e44ec3b2-0b4c-47ca-baa4-45cd5704cc24', 'serial': 'e44ec3b2-0b4c-47ca-baa4-45cd5704cc24'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:12:17 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:12:17 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXVkBRZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:12:17 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:12:17 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:12:17 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[470d2fb6-8d3e-4fae-bce7-e244f260eb1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:12:17 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[24963e01-4627-478c-a94e-27ffa34d14bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24] added
Jul 25 10:12:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[104ad2f5-8649-40ce-87c3-6d5462520f66]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c090912-f803-4b80-a210-25fb2288ff60]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXVkBRZa {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXVkBRZa" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e676c500-90d2-4b26-9d63-2229e8720d16]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IXVkBRZa'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb79bcd-72b2-4c09-aed3-bc1f9cfa8571]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3814e4d4-932e-44ce-a584-6d721d0ad20b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:12:17 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:12:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:12:17 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:12:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc9e9b3-c8d9-42a5-909a-d58044e28e70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24, portal: 172.16.0.220,3260]
Jul 25 10:12:17 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24, portal: 172.16.0.220,3260] successful.
Jul 25 10:12:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[209a4570-82bc-4528-9716-afe1c62cb8bb]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d5b5cc-aba4-4c20-b2fd-677c634e598b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:12:18 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:12:18 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:12:18 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:12:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:12:18 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:12:18 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:12:18 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:12:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:12:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:12:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:12:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:12:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[419807f9-2ab3-4f32-ba92-b058e8a62b09]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:12:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXVkBRZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23564663265323336', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564663265323336', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:12:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-580576116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-580576116',id=28,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b14fcd7739f41eabc9e7120f5b58a08',ramdisk_id='',reservation_id='r-h0xu7vza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-13369838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:12:05Z,user_data=None,user_id='96d25383d4b6448da2d30479a26bfa0f',uuid=b8e398f8-9e73-4077-a773-fdd1e494d37f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converting VIF {"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=39f60d81-9344-4fc4-917d-aa4dc290a5e0,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f60d81-93') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'pci_devices' on Instance uuid b8e398f8-9e73-4077-a773-fdd1e494d37f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:12:19 user nova-compute[71312]:   <uuid>b8e398f8-9e73-4077-a773-fdd1e494d37f</uuid>
Jul 25 10:12:19 user nova-compute[71312]:   <name>instance-0000001c</name>
Jul 25 10:12:19 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:12:19 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:12:19 user nova-compute[71312]:   <metadata>
Jul 25 10:12:19 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:12:19 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:12:19 user nova-compute[71312]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-580576116</nova:name>
Jul 25 10:12:19 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:12:17</nova:creationTime>
Jul 25 10:12:19 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:12:19 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:12:19 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:12:19 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:12:19 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:12:19 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:12:19 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:12:19 user nova-compute[71312]:       <nova:owner>
Jul 25 10:12:19 user nova-compute[71312]:         <nova:user uuid="96d25383d4b6448da2d30479a26bfa0f">tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member</nova:user>
Jul 25 10:12:19 user nova-compute[71312]:         <nova:project uuid="0b14fcd7739f41eabc9e7120f5b58a08">tempest-ServerBootFromVolumeStableRescueTest-13369838</nova:project>
Jul 25 10:12:19 user nova-compute[71312]:       </nova:owner>
Jul 25 10:12:19 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:12:19 user nova-compute[71312]:       <nova:ports>
Jul 25 10:12:19 user nova-compute[71312]:         <nova:port uuid="39f60d81-9344-4fc4-917d-aa4dc290a5e0">
Jul 25 10:12:19 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 10:12:19 user nova-compute[71312]:         </nova:port>
Jul 25 10:12:19 user nova-compute[71312]:       </nova:ports>
Jul 25 10:12:19 user nova-compute[71312]:     </nova:instance>
Jul 25 10:12:19 user nova-compute[71312]:   </metadata>
Jul 25 10:12:19 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:12:19 user nova-compute[71312]:     <system>
Jul 25 10:12:19 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:12:19 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:12:19 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:12:19 user nova-compute[71312]:       <entry name="serial">b8e398f8-9e73-4077-a773-fdd1e494d37f</entry>
Jul 25 10:12:19 user nova-compute[71312]:       <entry name="uuid">b8e398f8-9e73-4077-a773-fdd1e494d37f</entry>
Jul 25 10:12:19 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:12:19 user nova-compute[71312]:     </system>
Jul 25 10:12:19 user nova-compute[71312]:   </sysinfo>
Jul 25 10:12:19 user nova-compute[71312]:   <os>
Jul 25 10:12:19 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:12:19 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:12:19 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:12:19 user nova-compute[71312]:   </os>
Jul 25 10:12:19 user nova-compute[71312]:   <features>
Jul 25 10:12:19 user nova-compute[71312]:     <acpi/>
Jul 25 10:12:19 user nova-compute[71312]:     <apic/>
Jul 25 10:12:19 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:12:19 user nova-compute[71312]:   </features>
Jul 25 10:12:19 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:12:19 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:12:19 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:12:19 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:12:19 user nova-compute[71312]:   </clock>
Jul 25 10:12:19 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:12:19 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:12:19 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:12:19 user nova-compute[71312]:   </cpu>
Jul 25 10:12:19 user nova-compute[71312]:   <devices>
Jul 25 10:12:19 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:12:19 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:12:19 user nova-compute[71312]:       <source dev="/dev/sdd"/>
Jul 25 10:12:19 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:12:19 user nova-compute[71312]:       <serial>e44ec3b2-0b4c-47ca-baa4-45cd5704cc24</serial>
Jul 25 10:12:19 user nova-compute[71312]:     </disk>
Jul 25 10:12:19 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:12:19 user nova-compute[71312]:       <mac address="fa:16:3e:9d:94:99"/>
Jul 25 10:12:19 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:12:19 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:12:19 user nova-compute[71312]:       <target dev="tap39f60d81-93"/>
Jul 25 10:12:19 user nova-compute[71312]:     </interface>
Jul 25 10:12:19 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:12:19 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/console.log" append="off"/>
Jul 25 10:12:19 user nova-compute[71312]:     </serial>
Jul 25 10:12:19 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:12:19 user nova-compute[71312]:     <video>
Jul 25 10:12:19 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:12:19 user nova-compute[71312]:     </video>
Jul 25 10:12:19 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:12:19 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:12:19 user nova-compute[71312]:     </rng>
Jul 25 10:12:19 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:12:19 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:12:19 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:12:19 user nova-compute[71312]:     </memballoon>
Jul 25 10:12:19 user nova-compute[71312]:   </devices>
Jul 25 10:12:19 user nova-compute[71312]: </domain>
Jul 25 10:12:19 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:12:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-580576116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-580576116',id=28,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b14fcd7739f41eabc9e7120f5b58a08',ramdisk_id='',reservation_id='r-h0xu7vza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-13369838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:12:05Z,user_data=None,user_id='96d25383d4b6448da2d30479a26bfa0f',uuid=b8e398f8-9e73-4077-a773-fdd1e494d37f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converting VIF {"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=39f60d81-9344-4fc4-917d-aa4dc290a5e0,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f60d81-93') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG os_vif [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=39f60d81-9344-4fc4-917d-aa4dc290a5e0,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f60d81-93') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39f60d81-93, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39f60d81-93, col_values=(('external_ids', {'iface-id': '39f60d81-9344-4fc4-917d-aa4dc290a5e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:94:99', 'vm-uuid': 'b8e398f8-9e73-4077-a773-fdd1e494d37f'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:19 user nova-compute[71312]: INFO os_vif [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=39f60d81-9344-4fc4-917d-aa4dc290a5e0,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f60d81-93')
Jul 25 10:12:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] No VIF found with MAC fa:16:3e:9d:94:99, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:12:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-a3f32355-d714-476a-91f2-90019fb85497 req-7298fe2d-8796-4231-b9f7-dc94d3ab565f service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:12:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a3f32355-d714-476a-91f2-90019fb85497 req-7298fe2d-8796-4231-b9f7-dc94d3ab565f service nova] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a3f32355-d714-476a-91f2-90019fb85497 req-7298fe2d-8796-4231-b9f7-dc94d3ab565f service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a3f32355-d714-476a-91f2-90019fb85497 req-7298fe2d-8796-4231-b9f7-dc94d3ab565f service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-a3f32355-d714-476a-91f2-90019fb85497 req-7298fe2d-8796-4231-b9f7-dc94d3ab565f service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] No waiting events found dispatching network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:12:20 user nova-compute[71312]: WARNING nova.compute.manager [req-a3f32355-d714-476a-91f2-90019fb85497 req-7298fe2d-8796-4231-b9f7-dc94d3ab565f service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received unexpected event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 for instance with vm_state building and task_state spawning.
Jul 25 10:12:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279942.7296655, b8e398f8-9e73-4077-a773-fdd1e494d37f => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:12:22 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] VM Resumed (Lifecycle Event)
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:12:22 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Instance spawned successfully.
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:12:22 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279942.732499, b8e398f8-9e73-4077-a773-fdd1e494d37f => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:12:22 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] VM Started (Lifecycle Event)
Jul 25 10:12:22 user nova-compute[71312]: INFO nova.compute.manager [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Took 5.19 seconds to spawn the instance on the hypervisor.
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-10cf9579-2772-4840-8d0b-e50290b7221a req-4f17a98f-9a39-44c0-a33d-b46c775d35ca service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10cf9579-2772-4840-8d0b-e50290b7221a req-4f17a98f-9a39-44c0-a33d-b46c775d35ca service nova] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10cf9579-2772-4840-8d0b-e50290b7221a req-4f17a98f-9a39-44c0-a33d-b46c775d35ca service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10cf9579-2772-4840-8d0b-e50290b7221a req-4f17a98f-9a39-44c0-a33d-b46c775d35ca service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-10cf9579-2772-4840-8d0b-e50290b7221a req-4f17a98f-9a39-44c0-a33d-b46c775d35ca service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] No waiting events found dispatching network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:12:22 user nova-compute[71312]: WARNING nova.compute.manager [req-10cf9579-2772-4840-8d0b-e50290b7221a req-4f17a98f-9a39-44c0-a33d-b46c775d35ca service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received unexpected event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 for instance with vm_state building and task_state spawning.
Jul 25 10:12:22 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:12:22 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:12:22 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:12:23 user nova-compute[71312]: INFO nova.compute.manager [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Took 18.72 seconds to build instance.
Jul 25 10:12:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b90905a2-5c87-47ba-8f13-6c5166734471 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.908s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "e76c87fb-557c-4451-95c0-a55936db7e23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:12:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:12:23 user nova-compute[71312]: INFO nova.compute.claims [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Claim successful on node user
Jul 25 10:12:23 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:12:23 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:12:23 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:12:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:12:24 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:12:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG nova.policy [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9b48294a6374f439d94cb121c01dca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa44925fd09496683b46b15f728e9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:12:24 user nova-compute[71312]: INFO nova.virt.block_device [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Booting with volume 021e3404-c8a0-49c4-b976-7e9368b60577 at /dev/vda
Jul 25 10:12:24 user nova-compute[71312]: DEBUG os_brick.utils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c4db48-4eb7-4c1f-9e6b-ef9d40355e51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0c6ae4-75e8-4fff-9e18-1a671d775db2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9d9e90-0208-4628-b3de-f6e6b07b9e7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bc9b6d-c5a3-426b-8efb-5c0dd3ebcfa1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:12:24 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6d15bc-b7fb-4b7d-80ff-c2f36af4584d]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG os_brick.utils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Updating existing volume attachment record: 1ede1a37-c763-4144-b3b4-66aa0bbfcc91 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:12:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:12:25 user nova-compute[71312]: DEBUG nova.network.neutron [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Successfully created port: 41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:12:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:12:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Successfully updated port: 41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "refresh_cache-e76c87fb-557c-4451-95c0-a55936db7e23" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquired lock "refresh_cache-e76c87fb-557c-4451-95c0-a55936db7e23" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-a450e88b-a093-470d-ace7-e0d380d23a6c req-61a35e35-a208-4102-a37e-f828e0c5ad18 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-changed-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-a450e88b-a093-470d-ace7-e0d380d23a6c req-61a35e35-a208-4102-a37e-f828e0c5ad18 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Refreshing instance network info cache due to event network-changed-41f8981e-82cc-48ba-b87f-ff31cba61d8b. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a450e88b-a093-470d-ace7-e0d380d23a6c req-61a35e35-a208-4102-a37e-f828e0c5ad18 service nova] Acquiring lock "refresh_cache-e76c87fb-557c-4451-95c0-a55936db7e23" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Updating instance_info_cache with network_info: [{"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Updating instance_info_cache with network_info: [{"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Releasing lock "refresh_cache-e76c87fb-557c-4451-95c0-a55936db7e23" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Instance network_info: |[{"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a450e88b-a093-470d-ace7-e0d380d23a6c req-61a35e35-a208-4102-a37e-f828e0c5ad18 service nova] Acquired lock "refresh_cache-e76c87fb-557c-4451-95c0-a55936db7e23" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG nova.network.neutron [req-a450e88b-a093-470d-ace7-e0d380d23a6c req-61a35e35-a208-4102-a37e-f828e0c5ad18 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Refreshing network info cache for port 41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:12:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:12:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-a450e88b-a093-470d-ace7-e0d380d23a6c req-61a35e35-a208-4102-a37e-f828e0c5ad18 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Updated VIF entry in instance network info cache for port 41f8981e-82cc-48ba-b87f-ff31cba61d8b. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:12:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-a450e88b-a093-470d-ace7-e0d380d23a6c req-61a35e35-a208-4102-a37e-f828e0c5ad18 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Updating instance_info_cache with network_info: [{"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:12:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a450e88b-a093-470d-ace7-e0d380d23a6c req-61a35e35-a208-4102-a37e-f828e0c5ad18 service nova] Releasing lock "refresh_cache-e76c87fb-557c-4451-95c0-a55936db7e23" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:12:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:12:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:12:30 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:12:30 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7177MB free_disk=25.221099853515625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Applying migration context for instance cba49a3e-0ffe-4ea2-a956-bb41c178dd38 as it has an incoming, in-progress migration 0d134740-a63d-4124-936d-d34c7e863391. Migration status is finished {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 25 10:12:30 user nova-compute[71312]: INFO nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Updating resource usage from migration 0d134740-a63d-4124-936d-d34c7e863391
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 2e01c123-09c0-4a29-abf0-727f61484747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 80e8cdf1-c86a-43aa-a66c-46af281187a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 3d7de169-d5d4-4dc6-9980-ce586554323c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 93f45579-3a72-4646-8d47-2f47217e7ead actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Migration 0d134740-a63d-4124-936d-d34c7e863391 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance cba49a3e-0ffe-4ea2-a956-bb41c178dd38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 59f4ee46-2dcc-4609-99a2-d3260be757f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f5aa6ae1-551a-4f51-a29f-14612f9b17e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b8e398f8-9e73-4077-a773-fdd1e494d37f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 58a20181-bba3-43ad-bddc-a63abc7cf80a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance e76c87fb-557c-4451-95c0-a55936db7e23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:12:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:12:31 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:12:31 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:12:31 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:12:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.647s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:12:32 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Creating image(s)
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Ensure instance console log exists: /opt/stack/data/nova/instances/e76c87fb-557c-4451-95c0-a55936db7e23/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Start _get_guest_xml network_info=[{"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '1ede1a37-c763-4144-b3b4-66aa0bbfcc91', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCpnJYaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e76c87fb-557c-4451-95c0-a55936db7e23', 'attached_at': '', 'detached_at': '', 'volume_id': '021e3404-c8a0-49c4-b976-7e9368b60577', 'serial': '021e3404-c8a0-49c4-b976-7e9368b60577'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:12:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:12:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCpnJYaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:12:32 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:12:32 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:12:32 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fff2649-aab5-45d8-89bf-86f6e2532c6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:12:32 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[293fdf80-67e4-4ed5-8ddd-03ca6a26c9ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577] added
Jul 25 10:12:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[84839620-5d51-4edd-918c-75f728976269]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38025d5-e801-4fff-911e-07fd63efd301]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCpnJYaw {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCpnJYaw" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a719bf18-667e-4b13-89cc-918159fe063d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cCpnJYaw'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[837aca44-8387-4fc5-b4c7-b2e0f3ebff11]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0ebe1c-5c65-4614-991f-f451cf979325]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:12:32 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:12:32 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:12:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:12:32 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:12:32 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:12:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be66b03-be21-420f-a525-c42d74d12eee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260]
Jul 25 10:12:32 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260] successful.
Jul 25 10:12:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c0725e-17ab-4115-8d37-1353c27c116a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d51489-6d7f-48c2-be49-c09d21e8624f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:12:32 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:12:32 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:12:32 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:12:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:12:32 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:12:32 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:12:32 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:12:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deaf04a-c3f2-4c4d-ba0d-050c1346ec9e]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCpnJYaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23664633564666362', 'path': '/dev/sde'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664633564666362', 'path': '/dev/sde'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1094011526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1094011526',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOWd3fzd0CLBpf9IhL2nBunrCBai3U02DsR9QKrW6DhoW0y6gyAQObjWGKKtEv/XOkSt3jn2QhST3YzQp8xbbQ124cTSUJNFnQ6Rp4fiY4+CAboj8PhwW/HaVG5jTylvw==',key_name='tempest-keypair-735273049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8aa44925fd09496683b46b15f728e9ca',ramdisk_id='',reservation_id='r-l0ssij03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1599012039',owner_user_name='tempest-ServerActionsV293TestJSON-1599012039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9b48294a6374f439d94cb121c01dca9',uuid=e76c87fb-557c-4451-95c0-a55936db7e23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converting VIF {"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:64:08,bridge_name='br-int',has_traffic_filtering=True,id=41f8981e-82cc-48ba-b87f-ff31cba61d8b,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f8981e-82') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG nova.objects.instance [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lazy-loading 'pci_devices' on Instance uuid e76c87fb-557c-4451-95c0-a55936db7e23 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:12:33 user nova-compute[71312]:   <uuid>e76c87fb-557c-4451-95c0-a55936db7e23</uuid>
Jul 25 10:12:33 user nova-compute[71312]:   <name>instance-0000001e</name>
Jul 25 10:12:33 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:12:33 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:12:33 user nova-compute[71312]:   <metadata>
Jul 25 10:12:33 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:12:33 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:12:33 user nova-compute[71312]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1094011526</nova:name>
Jul 25 10:12:33 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:12:32</nova:creationTime>
Jul 25 10:12:33 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:12:33 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:12:33 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:12:33 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:12:33 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:12:33 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:12:33 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:12:33 user nova-compute[71312]:       <nova:owner>
Jul 25 10:12:33 user nova-compute[71312]:         <nova:user uuid="c9b48294a6374f439d94cb121c01dca9">tempest-ServerActionsV293TestJSON-1599012039-project-member</nova:user>
Jul 25 10:12:33 user nova-compute[71312]:         <nova:project uuid="8aa44925fd09496683b46b15f728e9ca">tempest-ServerActionsV293TestJSON-1599012039</nova:project>
Jul 25 10:12:33 user nova-compute[71312]:       </nova:owner>
Jul 25 10:12:33 user nova-compute[71312]:       <nova:ports>
Jul 25 10:12:33 user nova-compute[71312]:         <nova:port uuid="41f8981e-82cc-48ba-b87f-ff31cba61d8b">
Jul 25 10:12:33 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 10:12:33 user nova-compute[71312]:         </nova:port>
Jul 25 10:12:33 user nova-compute[71312]:       </nova:ports>
Jul 25 10:12:33 user nova-compute[71312]:     </nova:instance>
Jul 25 10:12:33 user nova-compute[71312]:   </metadata>
Jul 25 10:12:33 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:12:33 user nova-compute[71312]:     <system>
Jul 25 10:12:33 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:12:33 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:12:33 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:12:33 user nova-compute[71312]:       <entry name="serial">e76c87fb-557c-4451-95c0-a55936db7e23</entry>
Jul 25 10:12:33 user nova-compute[71312]:       <entry name="uuid">e76c87fb-557c-4451-95c0-a55936db7e23</entry>
Jul 25 10:12:33 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:12:33 user nova-compute[71312]:     </system>
Jul 25 10:12:33 user nova-compute[71312]:   </sysinfo>
Jul 25 10:12:33 user nova-compute[71312]:   <os>
Jul 25 10:12:33 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:12:33 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:12:33 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:12:33 user nova-compute[71312]:   </os>
Jul 25 10:12:33 user nova-compute[71312]:   <features>
Jul 25 10:12:33 user nova-compute[71312]:     <acpi/>
Jul 25 10:12:33 user nova-compute[71312]:     <apic/>
Jul 25 10:12:33 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:12:33 user nova-compute[71312]:   </features>
Jul 25 10:12:33 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:12:33 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:12:33 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:12:33 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:12:33 user nova-compute[71312]:   </clock>
Jul 25 10:12:33 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:12:33 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:12:33 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:12:33 user nova-compute[71312]:   </cpu>
Jul 25 10:12:33 user nova-compute[71312]:   <devices>
Jul 25 10:12:33 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:12:33 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:12:33 user nova-compute[71312]:       <source dev="/dev/sde"/>
Jul 25 10:12:33 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:12:33 user nova-compute[71312]:       <serial>021e3404-c8a0-49c4-b976-7e9368b60577</serial>
Jul 25 10:12:33 user nova-compute[71312]:     </disk>
Jul 25 10:12:33 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:12:33 user nova-compute[71312]:       <mac address="fa:16:3e:3f:64:08"/>
Jul 25 10:12:33 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:12:33 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:12:33 user nova-compute[71312]:       <target dev="tap41f8981e-82"/>
Jul 25 10:12:33 user nova-compute[71312]:     </interface>
Jul 25 10:12:33 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:12:33 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/e76c87fb-557c-4451-95c0-a55936db7e23/console.log" append="off"/>
Jul 25 10:12:33 user nova-compute[71312]:     </serial>
Jul 25 10:12:33 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:12:33 user nova-compute[71312]:     <video>
Jul 25 10:12:33 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:12:33 user nova-compute[71312]:     </video>
Jul 25 10:12:33 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:12:33 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:12:33 user nova-compute[71312]:     </rng>
Jul 25 10:12:33 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:12:33 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:12:33 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:12:33 user nova-compute[71312]:     </memballoon>
Jul 25 10:12:33 user nova-compute[71312]:   </devices>
Jul 25 10:12:33 user nova-compute[71312]: </domain>
Jul 25 10:12:33 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1094011526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1094011526',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOWd3fzd0CLBpf9IhL2nBunrCBai3U02DsR9QKrW6DhoW0y6gyAQObjWGKKtEv/XOkSt3jn2QhST3YzQp8xbbQ124cTSUJNFnQ6Rp4fiY4+CAboj8PhwW/HaVG5jTylvw==',key_name='tempest-keypair-735273049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8aa44925fd09496683b46b15f728e9ca',ramdisk_id='',reservation_id='r-l0ssij03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1599012039',owner_user_name='tempest-ServerActionsV293TestJSON-1599012039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9b48294a6374f439d94cb121c01dca9',uuid=e76c87fb-557c-4451-95c0-a55936db7e23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converting VIF {"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:64:08,bridge_name='br-int',has_traffic_filtering=True,id=41f8981e-82cc-48ba-b87f-ff31cba61d8b,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f8981e-82') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG os_vif [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:64:08,bridge_name='br-int',has_traffic_filtering=True,id=41f8981e-82cc-48ba-b87f-ff31cba61d8b,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f8981e-82') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41f8981e-82, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41f8981e-82, col_values=(('external_ids', {'iface-id': '41f8981e-82cc-48ba-b87f-ff31cba61d8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:64:08', 'vm-uuid': 'e76c87fb-557c-4451-95c0-a55936db7e23'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:33 user nova-compute[71312]: INFO os_vif [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:64:08,bridge_name='br-int',has_traffic_filtering=True,id=41f8981e-82cc-48ba-b87f-ff31cba61d8b,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f8981e-82')
Jul 25 10:12:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:12:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] No VIF found with MAC fa:16:3e:3f:64:08, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:12:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-78f2fbd0-5b33-4f69-88a8-a1d7bf79dd05 req-966c8343-6497-4b26-b9a6-b07b42ac4e9e service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:12:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-78f2fbd0-5b33-4f69-88a8-a1d7bf79dd05 req-966c8343-6497-4b26-b9a6-b07b42ac4e9e service nova] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-78f2fbd0-5b33-4f69-88a8-a1d7bf79dd05 req-966c8343-6497-4b26-b9a6-b07b42ac4e9e service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-78f2fbd0-5b33-4f69-88a8-a1d7bf79dd05 req-966c8343-6497-4b26-b9a6-b07b42ac4e9e service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-78f2fbd0-5b33-4f69-88a8-a1d7bf79dd05 req-966c8343-6497-4b26-b9a6-b07b42ac4e9e service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] No waiting events found dispatching network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:12:35 user nova-compute[71312]: WARNING nova.compute.manager [req-78f2fbd0-5b33-4f69-88a8-a1d7bf79dd05 req-966c8343-6497-4b26-b9a6-b07b42ac4e9e service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received unexpected event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b for instance with vm_state building and task_state spawning.
Jul 25 10:12:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-15c78dd4-9c9d-4f8b-8f25-d0d66d0a90ab req-c4eee696-f96d-463c-90a9-60e13f21a772 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15c78dd4-9c9d-4f8b-8f25-d0d66d0a90ab req-c4eee696-f96d-463c-90a9-60e13f21a772 service nova] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15c78dd4-9c9d-4f8b-8f25-d0d66d0a90ab req-c4eee696-f96d-463c-90a9-60e13f21a772 service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15c78dd4-9c9d-4f8b-8f25-d0d66d0a90ab req-c4eee696-f96d-463c-90a9-60e13f21a772 service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-15c78dd4-9c9d-4f8b-8f25-d0d66d0a90ab req-c4eee696-f96d-463c-90a9-60e13f21a772 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] No waiting events found dispatching network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:12:37 user nova-compute[71312]: WARNING nova.compute.manager [req-15c78dd4-9c9d-4f8b-8f25-d0d66d0a90ab req-c4eee696-f96d-463c-90a9-60e13f21a772 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received unexpected event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b for instance with vm_state building and task_state spawning.
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279957.2266414, e76c87fb-557c-4451-95c0-a55936db7e23 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:12:37 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] VM Resumed (Lifecycle Event)
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:12:37 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Instance spawned successfully.
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:37 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279957.2277946, e76c87fb-557c-4451-95c0-a55936db7e23 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:12:37 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] VM Started (Lifecycle Event)
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:12:37 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:12:37 user nova-compute[71312]: INFO nova.compute.manager [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Took 5.26 seconds to spawn the instance on the hypervisor.
Jul 25 10:12:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:12:37 user nova-compute[71312]: INFO nova.compute.manager [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Took 13.66 seconds to build instance.
Jul 25 10:12:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-af882e10-0f84-4ff8-8c8e-0ec6210bb35f tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "e76c87fb-557c-4451-95c0-a55936db7e23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.763s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "93222ef6-cba1-4427-a573-5c60c718db6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "93222ef6-cba1-4427-a573-5c60c718db6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:12:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:12:38 user nova-compute[71312]: INFO nova.compute.claims [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Claim successful on node user
Jul 25 10:12:39 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:12:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:12:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG nova.policy [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ec3ee9c206b43448eb6479cad0b437c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23211f867d6049f5bb1901e03e8dc396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:12:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Creating image(s)
Jul 25 10:12:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "/opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "/opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "/opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.183s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk 1073741824" returned: 0 in 0.053s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:40 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:12:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:40 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Cannot resize image /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:12:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'migration_context' on Instance uuid 93222ef6-cba1-4427-a573-5c60c718db6c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:12:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:12:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Ensure instance console log exists: /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:12:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Successfully created port: a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Successfully updated port: a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquired lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-e5a8a330-a37b-4696-b402-d718677d13b3 req-15d09252-8260-4c78-a715-69317cd7c012 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received event network-changed-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-e5a8a330-a37b-4696-b402-d718677d13b3 req-15d09252-8260-4c78-a715-69317cd7c012 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Refreshing instance network info cache due to event network-changed-a8db9b27-beab-4c26-a2d9-cc428589bf62. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e5a8a330-a37b-4696-b402-d718677d13b3 req-15d09252-8260-4c78-a715-69317cd7c012 service nova] Acquiring lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Updating instance_info_cache with network_info: [{"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Releasing lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Instance network_info: |[{"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e5a8a330-a37b-4696-b402-d718677d13b3 req-15d09252-8260-4c78-a715-69317cd7c012 service nova] Acquired lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-e5a8a330-a37b-4696-b402-d718677d13b3 req-15d09252-8260-4c78-a715-69317cd7c012 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Refreshing network info cache for port a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Start _get_guest_xml network_info=[{"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:12:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:12:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-228881500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-228881500',id=31,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3sczLA5TKbRelOtXVy7Hu+NIHQiYpa4nIRDi8+uN/qpmvSpM06eC3ZMc4BnGKGdQ0gOA0/RlOXlsTKbDSS+wvNME5SfN19jMxh5OYgcmvDxupr9/mJ5883mO5uMk+UEA==',key_name='tempest-keypair-1429184951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23211f867d6049f5bb1901e03e8dc396',ramdisk_id='',reservation_id='r-zkfj7ysk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1954806993',owner_user_name='tempest-AttachVolumeShelveTestJSON-1954806993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:12:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec3ee9c206b43448eb6479cad0b437c',uuid=93222ef6-cba1-4427-a573-5c60c718db6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converting VIF {"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:80:27,bridge_name='br-int',has_traffic_filtering=True,id=a8db9b27-beab-4c26-a2d9-cc428589bf62,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db9b27-be') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'pci_devices' on Instance uuid 93222ef6-cba1-4427-a573-5c60c718db6c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:12:41 user nova-compute[71312]:   <uuid>93222ef6-cba1-4427-a573-5c60c718db6c</uuid>
Jul 25 10:12:41 user nova-compute[71312]:   <name>instance-0000001f</name>
Jul 25 10:12:41 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:12:41 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:12:41 user nova-compute[71312]:   <metadata>
Jul 25 10:12:41 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:12:41 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:12:41 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-228881500</nova:name>
Jul 25 10:12:41 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:12:41</nova:creationTime>
Jul 25 10:12:41 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:12:41 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:12:41 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:12:41 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:12:41 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:12:41 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:12:41 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:12:41 user nova-compute[71312]:       <nova:owner>
Jul 25 10:12:41 user nova-compute[71312]:         <nova:user uuid="0ec3ee9c206b43448eb6479cad0b437c">tempest-AttachVolumeShelveTestJSON-1954806993-project-member</nova:user>
Jul 25 10:12:41 user nova-compute[71312]:         <nova:project uuid="23211f867d6049f5bb1901e03e8dc396">tempest-AttachVolumeShelveTestJSON-1954806993</nova:project>
Jul 25 10:12:41 user nova-compute[71312]:       </nova:owner>
Jul 25 10:12:41 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:12:41 user nova-compute[71312]:       <nova:ports>
Jul 25 10:12:41 user nova-compute[71312]:         <nova:port uuid="a8db9b27-beab-4c26-a2d9-cc428589bf62">
Jul 25 10:12:41 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 10:12:41 user nova-compute[71312]:         </nova:port>
Jul 25 10:12:41 user nova-compute[71312]:       </nova:ports>
Jul 25 10:12:41 user nova-compute[71312]:     </nova:instance>
Jul 25 10:12:41 user nova-compute[71312]:   </metadata>
Jul 25 10:12:41 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:12:41 user nova-compute[71312]:     <system>
Jul 25 10:12:41 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:12:41 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:12:41 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:12:41 user nova-compute[71312]:       <entry name="serial">93222ef6-cba1-4427-a573-5c60c718db6c</entry>
Jul 25 10:12:41 user nova-compute[71312]:       <entry name="uuid">93222ef6-cba1-4427-a573-5c60c718db6c</entry>
Jul 25 10:12:41 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:12:41 user nova-compute[71312]:     </system>
Jul 25 10:12:41 user nova-compute[71312]:   </sysinfo>
Jul 25 10:12:41 user nova-compute[71312]:   <os>
Jul 25 10:12:41 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:12:41 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:12:41 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:12:41 user nova-compute[71312]:   </os>
Jul 25 10:12:41 user nova-compute[71312]:   <features>
Jul 25 10:12:41 user nova-compute[71312]:     <acpi/>
Jul 25 10:12:41 user nova-compute[71312]:     <apic/>
Jul 25 10:12:41 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:12:41 user nova-compute[71312]:   </features>
Jul 25 10:12:41 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:12:41 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:12:41 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:12:41 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:12:41 user nova-compute[71312]:   </clock>
Jul 25 10:12:41 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:12:41 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:12:41 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:12:41 user nova-compute[71312]:   </cpu>
Jul 25 10:12:41 user nova-compute[71312]:   <devices>
Jul 25 10:12:41 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:12:41 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:12:41 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk"/>
Jul 25 10:12:41 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:12:41 user nova-compute[71312]:     </disk>
Jul 25 10:12:41 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:12:41 user nova-compute[71312]:       <mac address="fa:16:3e:16:80:27"/>
Jul 25 10:12:41 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:12:41 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:12:41 user nova-compute[71312]:       <target dev="tapa8db9b27-be"/>
Jul 25 10:12:41 user nova-compute[71312]:     </interface>
Jul 25 10:12:41 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:12:41 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/console.log" append="off"/>
Jul 25 10:12:41 user nova-compute[71312]:     </serial>
Jul 25 10:12:41 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:12:41 user nova-compute[71312]:     <video>
Jul 25 10:12:41 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:12:41 user nova-compute[71312]:     </video>
Jul 25 10:12:41 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:12:41 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:12:41 user nova-compute[71312]:     </rng>
Jul 25 10:12:41 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:12:41 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:12:41 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:12:41 user nova-compute[71312]:     </memballoon>
Jul 25 10:12:41 user nova-compute[71312]:   </devices>
Jul 25 10:12:41 user nova-compute[71312]: </domain>
Jul 25 10:12:41 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-228881500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-228881500',id=31,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3sczLA5TKbRelOtXVy7Hu+NIHQiYpa4nIRDi8+uN/qpmvSpM06eC3ZMc4BnGKGdQ0gOA0/RlOXlsTKbDSS+wvNME5SfN19jMxh5OYgcmvDxupr9/mJ5883mO5uMk+UEA==',key_name='tempest-keypair-1429184951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23211f867d6049f5bb1901e03e8dc396',ramdisk_id='',reservation_id='r-zkfj7ysk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1954806993',owner_user_name='tempest-AttachVolumeShelveTestJSON-1954806993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:12:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec3ee9c206b43448eb6479cad0b437c',uuid=93222ef6-cba1-4427-a573-5c60c718db6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converting VIF {"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:80:27,bridge_name='br-int',has_traffic_filtering=True,id=a8db9b27-beab-4c26-a2d9-cc428589bf62,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db9b27-be') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG os_vif [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:80:27,bridge_name='br-int',has_traffic_filtering=True,id=a8db9b27-beab-4c26-a2d9-cc428589bf62,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db9b27-be') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8db9b27-be, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa8db9b27-be, col_values=(('external_ids', {'iface-id': 'a8db9b27-beab-4c26-a2d9-cc428589bf62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:80:27', 'vm-uuid': '93222ef6-cba1-4427-a573-5c60c718db6c'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:41 user nova-compute[71312]: INFO os_vif [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:80:27,bridge_name='br-int',has_traffic_filtering=True,id=a8db9b27-beab-4c26-a2d9-cc428589bf62,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db9b27-be')
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:12:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] No VIF found with MAC fa:16:3e:16:80:27, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:12:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-e5a8a330-a37b-4696-b402-d718677d13b3 req-15d09252-8260-4c78-a715-69317cd7c012 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Updated VIF entry in instance network info cache for port a8db9b27-beab-4c26-a2d9-cc428589bf62. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:12:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-e5a8a330-a37b-4696-b402-d718677d13b3 req-15d09252-8260-4c78-a715-69317cd7c012 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Updating instance_info_cache with network_info: [{"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:12:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e5a8a330-a37b-4696-b402-d718677d13b3 req-15d09252-8260-4c78-a715-69317cd7c012 service nova] Releasing lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:12:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-791b8386-2225-4474-b129-acaab53c1a7a req-b1fec806-3a9d-4f9f-8930-71f414c773e4 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received event network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:12:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-791b8386-2225-4474-b129-acaab53c1a7a req-b1fec806-3a9d-4f9f-8930-71f414c773e4 service nova] Acquiring lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-791b8386-2225-4474-b129-acaab53c1a7a req-b1fec806-3a9d-4f9f-8930-71f414c773e4 service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-791b8386-2225-4474-b129-acaab53c1a7a req-b1fec806-3a9d-4f9f-8930-71f414c773e4 service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-791b8386-2225-4474-b129-acaab53c1a7a req-b1fec806-3a9d-4f9f-8930-71f414c773e4 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] No waiting events found dispatching network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:12:43 user nova-compute[71312]: WARNING nova.compute.manager [req-791b8386-2225-4474-b129-acaab53c1a7a req-b1fec806-3a9d-4f9f-8930-71f414c773e4 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received unexpected event network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 for instance with vm_state building and task_state spawning.
Jul 25 10:12:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279965.4624577, 93222ef6-cba1-4427-a573-5c60c718db6c => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:12:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] VM Resumed (Lifecycle Event)
Jul 25 10:12:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Instance spawned successfully.
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-0110b724-53c1-4672-b4be-050f1c9bf6ab req-bdaa3b6a-b85c-4540-b9cc-44c708efe904 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received event network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0110b724-53c1-4672-b4be-050f1c9bf6ab req-bdaa3b6a-b85c-4540-b9cc-44c708efe904 service nova] Acquiring lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0110b724-53c1-4672-b4be-050f1c9bf6ab req-bdaa3b6a-b85c-4540-b9cc-44c708efe904 service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0110b724-53c1-4672-b4be-050f1c9bf6ab req-bdaa3b6a-b85c-4540-b9cc-44c708efe904 service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-0110b724-53c1-4672-b4be-050f1c9bf6ab req-bdaa3b6a-b85c-4540-b9cc-44c708efe904 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] No waiting events found dispatching network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:12:45 user nova-compute[71312]: WARNING nova.compute.manager [req-0110b724-53c1-4672-b4be-050f1c9bf6ab req-bdaa3b6a-b85c-4540-b9cc-44c708efe904 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received unexpected event network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 for instance with vm_state building and task_state spawning.
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:12:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690279965.4633722, 93222ef6-cba1-4427-a573-5c60c718db6c => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:12:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] VM Started (Lifecycle Event)
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:12:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:12:45 user nova-compute[71312]: INFO nova.compute.manager [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Took 6.02 seconds to spawn the instance on the hypervisor.
Jul 25 10:12:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:12:45 user nova-compute[71312]: INFO nova.compute.manager [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Took 6.99 seconds to build instance.
Jul 25 10:12:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb2540af-5e6f-4cc6-bd65-6b0700dc890a tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "93222ef6-cba1-4427-a573-5c60c718db6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.101s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-49f71491-e035-4d8c-8946-78b708b0a99e req-e9b7a0d4-944d-40ae-b33a-2d78c8d7599b service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Received event network-changed-8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:12:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-49f71491-e035-4d8c-8946-78b708b0a99e req-e9b7a0d4-944d-40ae-b33a-2d78c8d7599b service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Refreshing instance network info cache due to event network-changed-8142a6be-137e-4810-83f1-670d40336235. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:12:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-49f71491-e035-4d8c-8946-78b708b0a99e req-e9b7a0d4-944d-40ae-b33a-2d78c8d7599b service nova] Acquiring lock "refresh_cache-3d7de169-d5d4-4dc6-9980-ce586554323c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:12:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-49f71491-e035-4d8c-8946-78b708b0a99e req-e9b7a0d4-944d-40ae-b33a-2d78c8d7599b service nova] Acquired lock "refresh_cache-3d7de169-d5d4-4dc6-9980-ce586554323c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:12:48 user nova-compute[71312]: DEBUG nova.network.neutron [req-49f71491-e035-4d8c-8946-78b708b0a99e req-e9b7a0d4-944d-40ae-b33a-2d78c8d7599b service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Refreshing network info cache for port 8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:12:48 user nova-compute[71312]: DEBUG nova.network.neutron [req-49f71491-e035-4d8c-8946-78b708b0a99e req-e9b7a0d4-944d-40ae-b33a-2d78c8d7599b service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Updated VIF entry in instance network info cache for port 8142a6be-137e-4810-83f1-670d40336235. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:12:48 user nova-compute[71312]: DEBUG nova.network.neutron [req-49f71491-e035-4d8c-8946-78b708b0a99e req-e9b7a0d4-944d-40ae-b33a-2d78c8d7599b service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Updating instance_info_cache with network_info: [{"id": "8142a6be-137e-4810-83f1-670d40336235", "address": "fa:16:3e:a2:38:4d", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8142a6be-13", "ovs_interfaceid": "8142a6be-137e-4810-83f1-670d40336235", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:12:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-49f71491-e035-4d8c-8946-78b708b0a99e req-e9b7a0d4-944d-40ae-b33a-2d78c8d7599b service nova] Releasing lock "refresh_cache-3d7de169-d5d4-4dc6-9980-ce586554323c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:12:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "3d7de169-d5d4-4dc6-9980-ce586554323c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'flavor' on Instance uuid 3d7de169-d5d4-4dc6-9980-ce586554323c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "3d7de169-d5d4-4dc6-9980-ce586554323c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:12:52 user nova-compute[71312]: INFO nova.compute.manager [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Attaching volume 2e8930b3-a96c-4387-8c3b-4d3a5c878c07 to /dev/vdb
Jul 25 10:12:52 user nova-compute[71312]: DEBUG os_brick.utils [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0d89e5-214c-4f4f-a953-e05660a4f9b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc05beaf-d72d-4cb4-b68a-7bd09f4b4413]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[70230182-470f-4bd7-9268-4db3145f3515]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[19243e1c-d8e3-4b59-8659-1c37baf88e66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:12:52 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:12:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d359b030-2620-4141-bcd2-1002c7c4b352]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG os_brick.utils [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:12:52 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Updating existing volume attachment record: 5caf868e-a1a7-4f1e-bd02-58e58b5b22e1 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:12:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSRNKGCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:12:59 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:12:59 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:12:59 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ab4d67-b231-446c-9534-7e4f6f842e31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:12:59 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cf8eea-c2a9-439d-94f2-950d463e951c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07] added
Jul 25 10:12:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c7199a-939a-4617-8603-25e984030659]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f325e1-5e2a-4d94-af28-13080cd42be5]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HSRNKGCg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HSRNKGCg" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f423d39-d646-487a-a652-2ba35e69ab47]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HSRNKGCg'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[993187ea-228a-4d79-a56a-94a2e6fa5afb]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff99df7-4b22-4b8a-86ce-c1f574fe9c40]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:12:59 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:12:59 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:12:59 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:12:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:12:59 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:12:59 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:12:59 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:12:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1fb1e9-1351-419b-babf-e1d5bc55649a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07, portal: 172.16.0.220,3260]
Jul 25 10:12:59 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07, portal: 172.16.0.220,3260] successful.
Jul 25 10:12:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[257da3cf-563e-43b0-a58f-bc13c33ebc4f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[af16d86a-a11f-470e-9c57-7a153ecfd2a6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:12:59 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:12:59 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:12:59 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:12:59 user nova-compute[71312]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 (non-flash)
Jul 25 10:12:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:12:59 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:12:59 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:12:59 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:12:59 user nova-compute[71312]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 (non-flash)
Jul 25 10:12:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[94960afd-7a40-47a3-b76e-614694566283]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSRNKGCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:12:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23865386430353238', 'path': '/dev/sdf'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:13:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865386430353238', 'path': '/dev/sdf'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:13:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'flavor' on Instance uuid 3d7de169-d5d4-4dc6-9980-ce586554323c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:13:00 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:13:00 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:13:00 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:13:00 user nova-compute[71312]:   <serial>2e8930b3-a96c-4387-8c3b-4d3a5c878c07</serial>
Jul 25 10:13:00 user nova-compute[71312]: </disk>
Jul 25 10:13:00 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:13:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] No VIF found with MAC fa:16:3e:a2:38:4d, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:13:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-023787b2-c885-4abc-9a02-aac26a3654b8 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.850s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "3d7de169-d5d4-4dc6-9980-ce586554323c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'flavor' on Instance uuid 3d7de169-d5d4-4dc6-9980-ce586554323c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "3d7de169-d5d4-4dc6-9980-ce586554323c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:04 user nova-compute[71312]: INFO nova.compute.manager [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Attaching volume c61d5d73-ad35-4631-8bbb-10e6683be6b0 to /dev/vdc
Jul 25 10:13:04 user nova-compute[71312]: DEBUG os_brick.utils [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5e0c70-4a9e-428b-b684-4c5be8e5d6fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5bdb3c-2679-43c9-881e-4e3a31489d84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0103427-e0e7-4853-9b09-95646ae08ff1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e532fb5-8c8a-4ce9-aebe-a3a4c80a3100]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:13:04 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:13:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8862fe7b-d8d0-4e4d-92ff-61853b6be8d4]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG os_brick.utils [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:13:04 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Updating existing volume attachment record: 1b233ae3-5cc4-44b5-953f-839b5753c745 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:13:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-82f262ec-9001-43aa-9e61-8068a4ac7409 req-31d41b6a-3975-460f-ac6a-4eb0ffe63462 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Received event network-changed-f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:13:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-82f262ec-9001-43aa-9e61-8068a4ac7409 req-31d41b6a-3975-460f-ac6a-4eb0ffe63462 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Refreshing instance network info cache due to event network-changed-f8788bc7-a010-4631-be89-f443cff123be. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:13:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-82f262ec-9001-43aa-9e61-8068a4ac7409 req-31d41b6a-3975-460f-ac6a-4eb0ffe63462 service nova] Acquiring lock "refresh_cache-93f45579-3a72-4646-8d47-2f47217e7ead" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:13:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-82f262ec-9001-43aa-9e61-8068a4ac7409 req-31d41b6a-3975-460f-ac6a-4eb0ffe63462 service nova] Acquired lock "refresh_cache-93f45579-3a72-4646-8d47-2f47217e7ead" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:13:06 user nova-compute[71312]: DEBUG nova.network.neutron [req-82f262ec-9001-43aa-9e61-8068a4ac7409 req-31d41b6a-3975-460f-ac6a-4eb0ffe63462 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Refreshing network info cache for port f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:13:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-82f262ec-9001-43aa-9e61-8068a4ac7409 req-31d41b6a-3975-460f-ac6a-4eb0ffe63462 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Updated VIF entry in instance network info cache for port f8788bc7-a010-4631-be89-f443cff123be. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:13:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-82f262ec-9001-43aa-9e61-8068a4ac7409 req-31d41b6a-3975-460f-ac6a-4eb0ffe63462 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Updating instance_info_cache with network_info: [{"id": "f8788bc7-a010-4631-be89-f443cff123be", "address": "fa:16:3e:77:ff:1b", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8788bc7-a0", "ovs_interfaceid": "f8788bc7-a010-4631-be89-f443cff123be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-82f262ec-9001-43aa-9e61-8068a4ac7409 req-31d41b6a-3975-460f-ac6a-4eb0ffe63462 service nova] Releasing lock "refresh_cache-93f45579-3a72-4646-8d47-2f47217e7ead" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "93f45579-3a72-4646-8d47-2f47217e7ead" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "93f45579-3a72-4646-8d47-2f47217e7ead" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'flavor' on Instance uuid 93f45579-3a72-4646-8d47-2f47217e7ead {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "93f45579-3a72-4646-8d47-2f47217e7ead" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "93f45579-3a72-4646-8d47-2f47217e7ead" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "93f45579-3a72-4646-8d47-2f47217e7ead" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:09 user nova-compute[71312]: INFO nova.compute.manager [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Attaching volume ea70eb0e-d612-406a-832d-a45d7d77ead9 to /dev/vdb
Jul 25 10:13:09 user nova-compute[71312]: DEBUG os_brick.utils [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8af2c6-6a36-44f1-80da-b803f72962dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0006a088-ec0d-434e-b3df-f5d4cccff38a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19748a1-0e4c-49cf-93a1-92c4d0c37c44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[349b4f5c-403a-400f-a1ce-12e37949012b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:13:09 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:13:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[702b6668-086b-4912-98da-8eac3478225e]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG os_brick.utils [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:13:09 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Updating existing volume attachment record: 9bb9fb52-3dca-43a7-99c8-48de8a964078 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:13:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Going to confirm migration 2 {{(pid=71312) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4693}}
Jul 25 10:13:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:13:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquired lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:13:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:13:10 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'info_cache' on Instance uuid cba49a3e-0ffe-4ea2-a956-bb41c178dd38 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Updating instance_info_cache with network_info: [{"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Releasing lock "refresh_cache-cba49a3e-0ffe-4ea2-a956-bb41c178dd38" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'migration_context' on Instance uuid cba49a3e-0ffe-4ea2-a956-bb41c178dd38 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VQWnfhzK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:13:11 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:13:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:13:11 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:13:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:13:11 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb440cd7-ddce-43ae-afde-b07abebb08f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:13:11 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc859fa3-bc63-437b-8ad8-da3497a2a47c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0] added
Jul 25 10:13:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f328d7bf-e0f1-4b1e-aeb0-66767f6b32da]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9489dfd7-9e00-4ffa-b591-0456b37834b1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VQWnfhzK {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VQWnfhzK" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b85923d-995b-40e5-afad-585d86dc7824]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VQWnfhzK'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.508s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3607cd-76e1-4e3d-9acc-05ff5cd6712b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6be8590-a6c0-4007-93ff-2d13009472c1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb09a686-d1c6-4522-8e23-3dc60eb928a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0, portal: 172.16.0.220,3260]
Jul 25 10:13:12 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0, portal: 172.16.0.220,3260] successful.
Jul 25 10:13:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5adaee3-2baf-4ae1-a529-e64dc693bd8f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7409c06-ec35-4f88-a956-32cb2a3bd740]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)
Jul 25 10:13:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:12 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Deleted allocation for migration 0d134740-a63d-4124-936d-d34c7e863391
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a77194-1d2c-4248-bd46-7862160639be]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca2286b-a4f9-42c4-a5da-bccdb03bc4cc tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.563s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:13 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:13:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VQWnfhzK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:13:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26430346337363365', 'path': '/dev/sdg'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:13:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430346337363365', 'path': '/dev/sdg'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:13:13 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'flavor' on Instance uuid 3d7de169-d5d4-4dc6-9980-ce586554323c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:13:13 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:13:13 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:13:13 user nova-compute[71312]:   <target dev="vdc" bus="virtio"/>
Jul 25 10:13:13 user nova-compute[71312]:   <serial>c61d5d73-ad35-4631-8bbb-10e6683be6b0</serial>
Jul 25 10:13:13 user nova-compute[71312]: </disk>
Jul 25 10:13:13 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:13:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] No VIF found with MAC fa:16:3e:a2:38:4d, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:13:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8e1cb6a3-0360-422a-a657-21908e837c86 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.052s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "3d7de169-d5d4-4dc6-9980-ce586554323c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:14 user nova-compute[71312]: INFO nova.compute.manager [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Detaching volume 2e8930b3-a96c-4387-8c3b-4d3a5c878c07
Jul 25 10:13:14 user nova-compute[71312]: INFO nova.virt.block_device [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Attempting to driver detach volume 2e8930b3-a96c-4387-8c3b-4d3a5c878c07 from mountpoint /dev/vdb
Jul 25 10:13:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Attempting to detach device vdb from instance 3d7de169-d5d4-4dc6-9980-ce586554323c from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:13:15 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:13:15 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:13:15 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:13:15 user nova-compute[71312]:   <serial>2e8930b3-a96c-4387-8c3b-4d3a5c878c07</serial>
Jul 25 10:13:15 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:13:15 user nova-compute[71312]: </disk>
Jul 25 10:13:15 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:13:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Successfully detached device vdb from instance 3d7de169-d5d4-4dc6-9980-ce586554323c from the persistent domain config.
Jul 25 10:13:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d7de169-d5d4-4dc6-9980-ce586554323c from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:13:15 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:13:15 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:13:15 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:13:15 user nova-compute[71312]:   <serial>2e8930b3-a96c-4387-8c3b-4d3a5c878c07</serial>
Jul 25 10:13:15 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:13:15 user nova-compute[71312]: </disk>
Jul 25 10:13:15 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279995.4576585, 3d7de169-d5d4-4dc6-9980-ce586554323c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d7de169-d5d4-4dc6-9980-ce586554323c {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:13:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Successfully detached device vdb from instance 3d7de169-d5d4-4dc6-9980-ce586554323c from the live domain config.
Jul 25 10:13:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSRNKGCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:13:15 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6053048-39c4-4db0-b2c7-67afc162a5be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:13:15 user nova-compute[71312]: No targets found.
Jul 25 10:13:15 user nova-compute[71312]: iSNS:
Jul 25 10:13:15 user nova-compute[71312]: No targets found.
Jul 25 10:13:15 user nova-compute[71312]: STATIC:
Jul 25 10:13:15 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:13:15 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:15 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:15 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0
Jul 25 10:13:15 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:15 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:15 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24
Jul 25 10:13:15 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:15 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:15 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e
Jul 25 10:13:15 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:15 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:15 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07
Jul 25 10:13:15 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:15 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:15 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577
Jul 25 10:13:15 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:15 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:15 user nova-compute[71312]: FIRMWARE:
Jul 25 10:13:15 user nova-compute[71312]: No targets found.
Jul 25 10:13:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:13:15 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:13:15 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d454eb40-bd7d-4428-9085-dc2a2421094c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf04d11-ed7e-4f80-a327-0865c6df0dd8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:15 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:15 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:15 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:15 user nova-compute[71312]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 (non-flash)
Jul 25 10:13:15 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)
Jul 25 10:13:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:15 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:15 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:15 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:15 user nova-compute[71312]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 (non-flash)
Jul 25 10:13:15 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)
Jul 25 10:13:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c03dad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07'): ({'sdf'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Removing single pathed devices sdf {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e48cb9a-a1d5-4e19-ad78-bcf6936a81e3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9995bc62-7746-4466-92da-48b965790e3f]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Flushing IO for device /dev/sdf {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1c8376-dae3-42d3-ab56-f6a2c5c7da09]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f445aa-1ec5-4f64-86a4-54f1f39f441e]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2943f0b7-2ec7-4b40-97be-dda6a7f04e68]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[712a1f3a-472c-4623-ba9d-e6f189dcfd8c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07, portal: 172.16.0.220,3260]
Jul 25 10:13:15 user nova-compute[71312]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07, portal: 172.16.0.220,3260] successful.
Jul 25 10:13:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8930b3-a96c-4387-8c3b-4d3a5c878c07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d758417a-1400-46a1-ac27-fb4aac3a6cca]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] <== disconnect_volume: return (328ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:13:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG nova.objects.instance [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'flavor' on Instance uuid 3d7de169-d5d4-4dc6-9980-ce586554323c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-588d00a4-96df-4f7f-8f25-52d8419201e2 tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.651s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofKAOVUT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:13:16 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:13:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:13:16 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:13:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:13:16 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8c1eb5-bc26-4a8b-a410-9bca05f32777]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:13:16 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a32917-4767-4c46-b606-3bcdb7bd0e9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9] added
Jul 25 10:13:16 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91e6e7c-30a6-4688-aaf4-0300b09df088]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfaf1c4-ca20-4438-8f2c-c3f185bdd72f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ofKAOVUT {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ofKAOVUT" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b847404b-41ef-4e82-a89a-941e0132631c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ofKAOVUT'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ea7fc0-5e1e-4d36-8ec5-edafb710b079]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4ff4ea-7449-4949-ba69-738a6fa5e505]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bfbe42-9f42-45db-9efa-a95d7deb91a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9, portal: 172.16.0.220,3260]
Jul 25 10:13:17 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9, portal: 172.16.0.220,3260] successful.
Jul 25 10:13:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41f45e5-5463-491e-b488-3b6b0288893a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad950365-75ff-4978-8057-8bea2025f4e5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 (non-flash)
Jul 25 10:13:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f31f866-2f86-4c51-b778-0522108063ec]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "3d7de169-d5d4-4dc6-9980-ce586554323c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:17 user nova-compute[71312]: INFO nova.compute.manager [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Detaching volume c61d5d73-ad35-4631-8bbb-10e6683be6b0
Jul 25 10:13:17 user nova-compute[71312]: INFO nova.virt.block_device [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Attempting to driver detach volume c61d5d73-ad35-4631-8bbb-10e6683be6b0 from mountpoint /dev/vdc
Jul 25 10:13:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Attempting to detach device vdc from instance 3d7de169-d5d4-4dc6-9980-ce586554323c from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:13:17 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:13:17 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:13:17 user nova-compute[71312]:   <target dev="vdc" bus="virtio"/>
Jul 25 10:13:17 user nova-compute[71312]:   <serial>c61d5d73-ad35-4631-8bbb-10e6683be6b0</serial>
Jul 25 10:13:17 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 10:13:17 user nova-compute[71312]: </disk>
Jul 25 10:13:17 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:13:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Successfully detached device vdc from instance 3d7de169-d5d4-4dc6-9980-ce586554323c from the persistent domain config.
Jul 25 10:13:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3d7de169-d5d4-4dc6-9980-ce586554323c from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:13:17 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:13:17 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:13:17 user nova-compute[71312]:   <target dev="vdc" bus="virtio"/>
Jul 25 10:13:17 user nova-compute[71312]:   <serial>c61d5d73-ad35-4631-8bbb-10e6683be6b0</serial>
Jul 25 10:13:17 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 10:13:17 user nova-compute[71312]: </disk>
Jul 25 10:13:17 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690279997.8760169, 3d7de169-d5d4-4dc6-9980-ce586554323c => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3d7de169-d5d4-4dc6-9980-ce586554323c {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:13:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Successfully detached device vdc from instance 3d7de169-d5d4-4dc6-9980-ce586554323c from the live domain config.
Jul 25 10:13:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:13:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VQWnfhzK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:13:17 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:13:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofKAOVUT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23665373037386635', 'path': '/dev/sdf'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665373037386635', 'path': '/dev/sdf'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.307s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'flavor' on Instance uuid 93f45579-3a72-4646-8d47-2f47217e7ead {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-a22159e7-23dc-43e4-8947-71cc96a455ab req-a0927435-ee9b-470c-9adc-0ba3b0d871c5 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Received event network-changed-9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-a22159e7-23dc-43e4-8947-71cc96a455ab req-a0927435-ee9b-470c-9adc-0ba3b0d871c5 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Refreshing instance network info cache due to event network-changed-9064e662-791e-46c5-b2e4-4f849ebba931. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a22159e7-23dc-43e4-8947-71cc96a455ab req-a0927435-ee9b-470c-9adc-0ba3b0d871c5 service nova] Acquiring lock "refresh_cache-59f4ee46-2dcc-4609-99a2-d3260be757f3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a22159e7-23dc-43e4-8947-71cc96a455ab req-a0927435-ee9b-470c-9adc-0ba3b0d871c5 service nova] Acquired lock "refresh_cache-59f4ee46-2dcc-4609-99a2-d3260be757f3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG nova.network.neutron [req-a22159e7-23dc-43e4-8947-71cc96a455ab req-a0927435-ee9b-470c-9adc-0ba3b0d871c5 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Refreshing network info cache for port 9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[62029469-de59-4467-b8a0-98ae12f7b12a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:13:18 user nova-compute[71312]: No targets found.
Jul 25 10:13:18 user nova-compute[71312]: iSNS:
Jul 25 10:13:18 user nova-compute[71312]: No targets found.
Jul 25 10:13:18 user nova-compute[71312]: STATIC:
Jul 25 10:13:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:13:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9
Jul 25 10:13:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0
Jul 25 10:13:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24
Jul 25 10:13:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e
Jul 25 10:13:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577
Jul 25 10:13:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:18 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:18 user nova-compute[71312]: FIRMWARE:
Jul 25 10:13:18 user nova-compute[71312]: No targets found.
Jul 25 10:13:18 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:13:18 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:13:18 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:13:18 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:13:18 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:13:18 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:13:18 user nova-compute[71312]:   <serial>ea70eb0e-d612-406a-832d-a45d7d77ead9</serial>
Jul 25 10:13:18 user nova-compute[71312]: </disk>
Jul 25 10:13:18 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d57243-5b99-4acc-a1d2-016b3bdc9862]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e18ad14-7643-412a-9ad1-b45291bc8e46]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:18 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:18 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:18 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:18 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)
Jul 25 10:13:18 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 (non-flash)
Jul 25 10:13:18 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:18 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:18 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:18 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:18 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 (non-flash)
Jul 25 10:13:18 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 (non-flash)
Jul 25 10:13:18 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a87f13f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0'): ({'sdg'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Removing single pathed devices sdg {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66669a3-ab70-48e3-a7f3-b8f90689e460]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e1eda7-e057-4e23-982d-69e0746d5f07]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Flushing IO for device /dev/sdg {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[400e1a6e-fa89-457c-8259-a564fe708305]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc022a17-eaa5-4126-a2cc-be5f0971e2ac]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66d1392-bde9-400e-97c1-29c24c97ccc1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6798f175-e8d4-4799-b681-33d780eeebf2]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0, portal: 172.16.0.220,3260]
Jul 25 10:13:18 user nova-compute[71312]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0, portal: 172.16.0.220,3260] successful.
Jul 25 10:13:18 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c61d5d73-ad35-4631-8bbb-10e6683be6b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9e03f4-6126-4d5c-b913-b7296aa42160]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] <== disconnect_volume: return (657ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] No VIF found with MAC fa:16:3e:77:ff:1b, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4d4e3091-ab9b-4684-b65b-492c2ef79623 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "93f45579-3a72-4646-8d47-2f47217e7ead" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.030s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG nova.network.neutron [req-a22159e7-23dc-43e4-8947-71cc96a455ab req-a0927435-ee9b-470c-9adc-0ba3b0d871c5 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Updated VIF entry in instance network info cache for port 9064e662-791e-46c5-b2e4-4f849ebba931. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG nova.network.neutron [req-a22159e7-23dc-43e4-8947-71cc96a455ab req-a0927435-ee9b-470c-9adc-0ba3b0d871c5 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Updating instance_info_cache with network_info: [{"id": "9064e662-791e-46c5-b2e4-4f849ebba931", "address": "fa:16:3e:4e:aa:8e", "network": {"id": "8b90228d-c790-453e-9cd3-56aa4386ea58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1601377159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbd5e7b5d6b4aa48bb91c435a296bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9064e662-79", "ovs_interfaceid": "9064e662-791e-46c5-b2e4-4f849ebba931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a22159e7-23dc-43e4-8947-71cc96a455ab req-a0927435-ee9b-470c-9adc-0ba3b0d871c5 service nova] Releasing lock "refresh_cache-59f4ee46-2dcc-4609-99a2-d3260be757f3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lazy-loading 'flavor' on Instance uuid 59f4ee46-2dcc-4609-99a2-d3260be757f3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'flavor' on Instance uuid 3d7de169-d5d4-4dc6-9980-ce586554323c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b310e12f-b4ad-4797-9975-133d5d0bc56d tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.936s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:19 user nova-compute[71312]: INFO nova.compute.manager [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Attaching volume f69f81f2-787c-4b24-84b3-3b1c8963d987 to /dev/vdb
Jul 25 10:13:19 user nova-compute[71312]: DEBUG os_brick.utils [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfd8d11-142a-48b6-9436-97f0dd0cb30d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf1e655-96d8-4089-9355-9841d73ebb38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[82695728-4905-4a88-887c-f9278121b24f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43b057c-df75-458d-b5fa-9c2312112b8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:13:19 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c16358-4180-4ce8-a974-c732d52c582b]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG os_brick.utils [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Updating existing volume attachment record: 7a35c10d-22f7-4bd0-96a6-913b0b38d9b9 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "93f45579-3a72-4646-8d47-2f47217e7ead" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "93f45579-3a72-4646-8d47-2f47217e7ead" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:19 user nova-compute[71312]: INFO nova.compute.manager [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Detaching volume ea70eb0e-d612-406a-832d-a45d7d77ead9
Jul 25 10:13:19 user nova-compute[71312]: INFO nova.virt.block_device [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Attempting to driver detach volume ea70eb0e-d612-406a-832d-a45d7d77ead9 from mountpoint /dev/vdb
Jul 25 10:13:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Attempting to detach device vdb from instance 93f45579-3a72-4646-8d47-2f47217e7ead from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:13:19 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:13:19 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:13:19 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:13:19 user nova-compute[71312]:   <serial>ea70eb0e-d612-406a-832d-a45d7d77ead9</serial>
Jul 25 10:13:19 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:13:19 user nova-compute[71312]: </disk>
Jul 25 10:13:19 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:13:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Successfully detached device vdb from instance 93f45579-3a72-4646-8d47-2f47217e7ead from the persistent domain config.
Jul 25 10:13:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93f45579-3a72-4646-8d47-2f47217e7ead from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:13:19 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:13:19 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:13:19 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:13:19 user nova-compute[71312]:   <serial>ea70eb0e-d612-406a-832d-a45d7d77ead9</serial>
Jul 25 10:13:19 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:13:19 user nova-compute[71312]: </disk>
Jul 25 10:13:19 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "3d7de169-d5d4-4dc6-9980-ce586554323c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:20 user nova-compute[71312]: INFO nova.compute.manager [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Terminating instance
Jul 25 10:13:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690280000.3020482, 93f45579-3a72-4646-8d47-2f47217e7ead => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93f45579-3a72-4646-8d47-2f47217e7ead {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:13:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Successfully detached device vdb from instance 93f45579-3a72-4646-8d47-2f47217e7ead from the live domain config.
Jul 25 10:13:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofKAOVUT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:13:20 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-7af93dc0-7550-44e9-8fc1-44622a7d16a5 req-6d664ae3-712b-4819-8e9c-83180d176463 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Received event network-vif-unplugged-8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7af93dc0-7550-44e9-8fc1-44622a7d16a5 req-6d664ae3-712b-4819-8e9c-83180d176463 service nova] Acquiring lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7af93dc0-7550-44e9-8fc1-44622a7d16a5 req-6d664ae3-712b-4819-8e9c-83180d176463 service nova] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7af93dc0-7550-44e9-8fc1-44622a7d16a5 req-6d664ae3-712b-4819-8e9c-83180d176463 service nova] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-7af93dc0-7550-44e9-8fc1-44622a7d16a5 req-6d664ae3-712b-4819-8e9c-83180d176463 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] No waiting events found dispatching network-vif-unplugged-8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-7af93dc0-7550-44e9-8fc1-44622a7d16a5 req-6d664ae3-712b-4819-8e9c-83180d176463 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Received event network-vif-unplugged-8142a6be-137e-4810-83f1-670d40336235 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[193ac9bd-3487-4965-b425-d9279272865d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:13:20 user nova-compute[71312]: No targets found.
Jul 25 10:13:20 user nova-compute[71312]: iSNS:
Jul 25 10:13:20 user nova-compute[71312]: No targets found.
Jul 25 10:13:20 user nova-compute[71312]: STATIC:
Jul 25 10:13:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:13:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9
Jul 25 10:13:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24
Jul 25 10:13:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e
Jul 25 10:13:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577
Jul 25 10:13:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:20 user nova-compute[71312]: FIRMWARE:
Jul 25 10:13:20 user nova-compute[71312]: No targets found.
Jul 25 10:13:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:13:20 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:13:20 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9effebb6-3795-48cf-b41b-7ff5c167d53c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3395be29-fa92-49fa-a2cd-7d4154e2c4b6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:20 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:20 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:20 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:20 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 (non-flash)
Jul 25 10:13:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:20 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:20 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:20 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:20 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 (non-flash)
Jul 25 10:13:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9cc8cc700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9'): ({'sdf'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Removing single pathed devices sdf {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f5006b-285a-49fc-b5e3-ea4fdd04716b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb97d24-124f-44b4-b47b-9e96c125fc25]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Flushing IO for device /dev/sdf {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81a982a-3930-4047-b7ff-1c15a8e0e98b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24c1613-fc0e-4e1d-b9a9-854215a4c46a]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d700328a-e9f7-4ab0-a621-abefbd51984d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0184dea7-8a0a-42f9-a6d6-853bbab6245b]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9, portal: 172.16.0.220,3260]
Jul 25 10:13:20 user nova-compute[71312]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9, portal: 172.16.0.220,3260] successful.
Jul 25 10:13:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea70eb0e-d612-406a-832d-a45d7d77ead9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba99e2f-dbe8-44fb-8fd0-d81252a9b145]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] <== disconnect_volume: return (355ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:13:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Instance destroyed successfully.
Jul 25 10:13:20 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lazy-loading 'resources' on Instance uuid 3d7de169-d5d4-4dc6-9980-ce586554323c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1731897971',display_name='tempest-AttachVolumeTestJSON-server-1731897971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1731897971',id=24,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP76U8pOmQj0T6UoWSIE8MwYl2QViBDvJlo+6VIrFrd7xplbfhajk4osrb3h0o5ol89Nr8I1EP7YXP/3x5K5kTv1MomBI4WO3sMBcDllyxK4gqCJXNgaWE4MYBg1SFtLiQ==',key_name='tempest-keypair-689919311',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:11:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68cb9228183844d5853c6c2a35f2658f',ramdisk_id='',reservation_id='r-vgzgne07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095711794',owner_user_name='tempest-AttachVolumeTestJSON-1095711794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48272d2a58644b2b8b6a9c42b51c746',uuid=3d7de169-d5d4-4dc6-9980-ce586554323c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8142a6be-137e-4810-83f1-670d40336235", "address": "fa:16:3e:a2:38:4d", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8142a6be-13", "ovs_interfaceid": "8142a6be-137e-4810-83f1-670d40336235", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converting VIF {"id": "8142a6be-137e-4810-83f1-670d40336235", "address": "fa:16:3e:a2:38:4d", "network": {"id": "3d6a35fb-02c5-4bca-b36e-a84cddd887a3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1744257703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68cb9228183844d5853c6c2a35f2658f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8142a6be-13", "ovs_interfaceid": "8142a6be-137e-4810-83f1-670d40336235", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:38:4d,bridge_name='br-int',has_traffic_filtering=True,id=8142a6be-137e-4810-83f1-670d40336235,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8142a6be-13') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG os_vif [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:38:4d,bridge_name='br-int',has_traffic_filtering=True,id=8142a6be-137e-4810-83f1-670d40336235,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8142a6be-13') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8142a6be-13, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:20 user nova-compute[71312]: INFO os_vif [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:38:4d,bridge_name='br-int',has_traffic_filtering=True,id=8142a6be-137e-4810-83f1-670d40336235,network=Network(3d6a35fb-02c5-4bca-b36e-a84cddd887a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8142a6be-13')
Jul 25 10:13:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Deleting instance files /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c_del
Jul 25 10:13:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Deletion of /opt/stack/data/nova/instances/3d7de169-d5d4-4dc6-9980-ce586554323c_del complete
Jul 25 10:13:20 user nova-compute[71312]: INFO nova.compute.manager [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 25 10:13:20 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:13:20 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:13:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'flavor' on Instance uuid 93f45579-3a72-4646-8d47-2f47217e7ead {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-be1effa8-6073-4948-9391-7960bc8988b3 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "93f45579-3a72-4646-8d47-2f47217e7ead" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.739s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:21 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:13:21 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Took 0.87 seconds to deallocate network for instance.
Jul 25 10:13:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-7cb1bf12-dcd3-44db-ab16-1b7aa6d0ab92 req-5df1f6d8-bf7e-4805-8690-e5d4045a07d2 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Received event network-vif-deleted-8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:13:21 user nova-compute[71312]: INFO nova.compute.manager [req-7cb1bf12-dcd3-44db-ab16-1b7aa6d0ab92 req-5df1f6d8-bf7e-4805-8690-e5d4045a07d2 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Neutron deleted interface 8142a6be-137e-4810-83f1-670d40336235; detaching it from the instance and deleting it from the info cache
Jul 25 10:13:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-7cb1bf12-dcd3-44db-ab16-1b7aa6d0ab92 req-5df1f6d8-bf7e-4805-8690-e5d4045a07d2 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:13:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-7cb1bf12-dcd3-44db-ab16-1b7aa6d0ab92 req-5df1f6d8-bf7e-4805-8690-e5d4045a07d2 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Detach interface failed, port_id=8142a6be-137e-4810-83f1-670d40336235, reason: Instance 3d7de169-d5d4-4dc6-9980-ce586554323c could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:13:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:22 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:13:22 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:22 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Deleted allocations for instance 3d7de169-d5d4-4dc6-9980-ce586554323c
Jul 25 10:13:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-0ac612a7-42b6-48a5-8746-50790ed147d3 req-af4b14c6-5d12-476e-8c66-24393bcc8777 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Received event network-vif-plugged-8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0ac612a7-42b6-48a5-8746-50790ed147d3 req-af4b14c6-5d12-476e-8c66-24393bcc8777 service nova] Acquiring lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0ac612a7-42b6-48a5-8746-50790ed147d3 req-af4b14c6-5d12-476e-8c66-24393bcc8777 service nova] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0ac612a7-42b6-48a5-8746-50790ed147d3 req-af4b14c6-5d12-476e-8c66-24393bcc8777 service nova] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-0ac612a7-42b6-48a5-8746-50790ed147d3 req-af4b14c6-5d12-476e-8c66-24393bcc8777 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] No waiting events found dispatching network-vif-plugged-8142a6be-137e-4810-83f1-670d40336235 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:13:22 user nova-compute[71312]: WARNING nova.compute.manager [req-0ac612a7-42b6-48a5-8746-50790ed147d3 req-af4b14c6-5d12-476e-8c66-24393bcc8777 service nova] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Received unexpected event network-vif-plugged-8142a6be-137e-4810-83f1-670d40336235 for instance with vm_state deleted and task_state None.
Jul 25 10:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e9b54bcc-9ec8-459c-a717-73b6e42522cd tempest-AttachVolumeTestJSON-1095711794 tempest-AttachVolumeTestJSON-1095711794-project-member] Lock "3d7de169-d5d4-4dc6-9980-ce586554323c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.389s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:23 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:13:23 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:13:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:13:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:13:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:13:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fIliAEBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:13:26 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:13:26 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:13:26 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e351b26a-0f6e-47ec-ba05-1d101ec2982b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:13:26 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d9d4c0-eacf-48f0-97d0-dd46db7c8869]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987] added
Jul 25 10:13:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1788168-2789-42f5-9b5f-e66e2d70f877]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b4bfab-f324-498d-b80d-9262ab7ebd8f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fIliAEBm {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fIliAEBm" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e27f35-e75d-4fc1-b496-ee5975337462]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fIliAEBm'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[533763dc-78a7-4a34-aa26-b2d76d821404]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2fc172-2196-416d-8941-6f997a6bafd7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:26 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:26 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:26 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:26 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:26 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:26 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9039e33-a533-4eb8-a969-8a425118797a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987, portal: 172.16.0.220,3260]
Jul 25 10:13:26 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987, portal: 172.16.0.220,3260] successful.
Jul 25 10:13:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d08033-2b66-43a8-8c18-a665e20a4e6e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c34074-f309-4bef-a9bb-869e6561d10b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:26 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:26 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:26 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:26 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:13:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:26 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:26 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:26 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:26 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:13:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[113ceefb-4cf8-4f0d-9adf-9228a00a7608]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:13:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:13:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-2e01c123-09c0-4a29-abf0-727f61484747" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:13:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-2e01c123-09c0-4a29-abf0-727f61484747" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:13:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:13:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Updating instance_info_cache with network_info: [{"id": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "address": "fa:16:3e:b4:f1:6b", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22e0953e-fa", "ovs_interfaceid": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:13:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-2e01c123-09c0-4a29-abf0-727f61484747" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:13:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:13:27 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:13:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fIliAEBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:13:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23338313062363266', 'path': '/dev/sdf'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:13:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338313062363266', 'path': '/dev/sdf'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:13:27 user nova-compute[71312]: DEBUG nova.objects.instance [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lazy-loading 'flavor' on Instance uuid 59f4ee46-2dcc-4609-99a2-d3260be757f3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:13:27 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:13:27 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:13:27 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:13:27 user nova-compute[71312]:   <serial>f69f81f2-787c-4b24-84b3-3b1c8963d987</serial>
Jul 25 10:13:27 user nova-compute[71312]: </disk>
Jul 25 10:13:27 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:13:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:13:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] No VIF found with MAC fa:16:3e:4e:aa:8e, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:13:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-31e48ad3-259d-4c5c-a360-a9d603b8c44c tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.900s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:13:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:13:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:13:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:13:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=6808MB free_disk=25.188304901123047GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lazy-loading 'flavor' on Instance uuid 59f4ee46-2dcc-4609-99a2-d3260be757f3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 2e01c123-09c0-4a29-abf0-727f61484747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 80e8cdf1-c86a-43aa-a66c-46af281187a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 93f45579-3a72-4646-8d47-2f47217e7ead actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance cba49a3e-0ffe-4ea2-a956-bb41c178dd38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 59f4ee46-2dcc-4609-99a2-d3260be757f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f5aa6ae1-551a-4f51-a29f-14612f9b17e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b8e398f8-9e73-4077-a773-fdd1e494d37f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 58a20181-bba3-43ad-bddc-a63abc7cf80a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance e76c87fb-557c-4451-95c0-a55936db7e23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 93222ef6-cba1-4427-a573-5c60c718db6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:32 user nova-compute[71312]: INFO nova.compute.manager [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Attaching volume 67b3bac3-4f75-49df-8645-26029a5123b3 to /dev/vdc
Jul 25 10:13:32 user nova-compute[71312]: DEBUG os_brick.utils [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb862cea-559e-44e1-887b-6e7c3de3a896]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0604e079-68ef-40fd-891a-1eba7503dc6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e59d0b-c33b-4a33-979e-928863538ca9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83b15ed-8fcc-45f7-94a6-cfa526d8741b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:13:32 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[497fcf8c-f75d-461a-80c9-b07aa9f7cf2b]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG os_brick.utils [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Updating existing volume attachment record: 2dace374-1f24-4d0a-a3a9-b323af674205 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:13:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.608s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "59bade05-0eb7-4f92-ac8a-187865211d4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "59bade05-0eb7-4f92-ac8a-187865211d4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:13:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:33 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:13:33 user nova-compute[71312]: INFO nova.compute.claims [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Claim successful on node user
Jul 25 10:13:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:13:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:13:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG nova.policy [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3597b22f53c54e5ab63730caefea2369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2222bf62bf487c911c811dbd8df8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:13:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Creating image(s)
Jul 25 10:13:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "/opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "/opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "/opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/disk 1073741824" returned: 0 in 0.053s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:35 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:13:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:35 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Cannot resize image /opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:13:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lazy-loading 'migration_context' on Instance uuid 59bade05-0eb7-4f92-ac8a-187865211d4f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Successfully created port: 7040a661-8a32-44a1-a85c-cb15f43c6e37 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:13:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:13:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Ensure instance console log exists: /opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:13:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:35 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280000.7768414, 3d7de169-d5d4-4dc6-9980-ce586554323c => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:13:35 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] VM Stopped (Lifecycle Event)
Jul 25 10:13:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f799fa0e-b725-452c-8a17-5eace5d59b97 None None] [instance: 3d7de169-d5d4-4dc6-9980-ce586554323c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:13:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Successfully updated port: 7040a661-8a32-44a1-a85c-cb15f43c6e37 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "refresh_cache-59bade05-0eb7-4f92-ac8a-187865211d4f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquired lock "refresh_cache-59bade05-0eb7-4f92-ac8a-187865211d4f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-6bec85b6-f1aa-418a-81da-82f78e794f91 req-2d8e70e3-2d77-4e1f-bd29-7ed0c5961d7d service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Received event network-changed-7040a661-8a32-44a1-a85c-cb15f43c6e37 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-6bec85b6-f1aa-418a-81da-82f78e794f91 req-2d8e70e3-2d77-4e1f-bd29-7ed0c5961d7d service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Refreshing instance network info cache due to event network-changed-7040a661-8a32-44a1-a85c-cb15f43c6e37. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6bec85b6-f1aa-418a-81da-82f78e794f91 req-2d8e70e3-2d77-4e1f-bd29-7ed0c5961d7d service nova] Acquiring lock "refresh_cache-59bade05-0eb7-4f92-ac8a-187865211d4f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Updating instance_info_cache with network_info: [{"id": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "address": "fa:16:3e:f3:17:58", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7040a661-8a", "ovs_interfaceid": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Releasing lock "refresh_cache-59bade05-0eb7-4f92-ac8a-187865211d4f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Instance network_info: |[{"id": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "address": "fa:16:3e:f3:17:58", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7040a661-8a", "ovs_interfaceid": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6bec85b6-f1aa-418a-81da-82f78e794f91 req-2d8e70e3-2d77-4e1f-bd29-7ed0c5961d7d service nova] Acquired lock "refresh_cache-59bade05-0eb7-4f92-ac8a-187865211d4f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.network.neutron [req-6bec85b6-f1aa-418a-81da-82f78e794f91 req-2d8e70e3-2d77-4e1f-bd29-7ed0c5961d7d service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Refreshing network info cache for port 7040a661-8a32-44a1-a85c-cb15f43c6e37 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Start _get_guest_xml network_info=[{"id": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "address": "fa:16:3e:f3:17:58", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7040a661-8a", "ovs_interfaceid": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:13:36 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:13:36 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-380768823',display_name='tempest-ServersNegativeTestJSON-server-380768823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-380768823',id=32,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e2222bf62bf487c911c811dbd8df8f1',ramdisk_id='',reservation_id='r-lajj6t21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-404227801',owner_user_name='tempest-ServersNegativeTestJSON-404227801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:13:35Z,user_data=None,user_id='3597b22f53c54e5ab63730caefea2369',uuid=59bade05-0eb7-4f92-ac8a-187865211d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "address": "fa:16:3e:f3:17:58", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7040a661-8a", "ovs_interfaceid": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Converting VIF {"id": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "address": "fa:16:3e:f3:17:58", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7040a661-8a", "ovs_interfaceid": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:17:58,bridge_name='br-int',has_traffic_filtering=True,id=7040a661-8a32-44a1-a85c-cb15f43c6e37,network=Network(44edfeb7-92a1-4284-ae77-c7d1e351aa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7040a661-8a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:13:36 user nova-compute[71312]: DEBUG nova.objects.instance [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lazy-loading 'pci_devices' on Instance uuid 59bade05-0eb7-4f92-ac8a-187865211d4f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:13:37 user nova-compute[71312]:   <uuid>59bade05-0eb7-4f92-ac8a-187865211d4f</uuid>
Jul 25 10:13:37 user nova-compute[71312]:   <name>instance-00000020</name>
Jul 25 10:13:37 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:13:37 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:13:37 user nova-compute[71312]:   <metadata>
Jul 25 10:13:37 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:13:37 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:13:37 user nova-compute[71312]:       <nova:name>tempest-ServersNegativeTestJSON-server-380768823</nova:name>
Jul 25 10:13:37 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:13:36</nova:creationTime>
Jul 25 10:13:37 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:13:37 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:13:37 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:13:37 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:13:37 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:13:37 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:13:37 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:13:37 user nova-compute[71312]:       <nova:owner>
Jul 25 10:13:37 user nova-compute[71312]:         <nova:user uuid="3597b22f53c54e5ab63730caefea2369">tempest-ServersNegativeTestJSON-404227801-project-member</nova:user>
Jul 25 10:13:37 user nova-compute[71312]:         <nova:project uuid="1e2222bf62bf487c911c811dbd8df8f1">tempest-ServersNegativeTestJSON-404227801</nova:project>
Jul 25 10:13:37 user nova-compute[71312]:       </nova:owner>
Jul 25 10:13:37 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:13:37 user nova-compute[71312]:       <nova:ports>
Jul 25 10:13:37 user nova-compute[71312]:         <nova:port uuid="7040a661-8a32-44a1-a85c-cb15f43c6e37">
Jul 25 10:13:37 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 10:13:37 user nova-compute[71312]:         </nova:port>
Jul 25 10:13:37 user nova-compute[71312]:       </nova:ports>
Jul 25 10:13:37 user nova-compute[71312]:     </nova:instance>
Jul 25 10:13:37 user nova-compute[71312]:   </metadata>
Jul 25 10:13:37 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:13:37 user nova-compute[71312]:     <system>
Jul 25 10:13:37 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:13:37 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:13:37 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:13:37 user nova-compute[71312]:       <entry name="serial">59bade05-0eb7-4f92-ac8a-187865211d4f</entry>
Jul 25 10:13:37 user nova-compute[71312]:       <entry name="uuid">59bade05-0eb7-4f92-ac8a-187865211d4f</entry>
Jul 25 10:13:37 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:13:37 user nova-compute[71312]:     </system>
Jul 25 10:13:37 user nova-compute[71312]:   </sysinfo>
Jul 25 10:13:37 user nova-compute[71312]:   <os>
Jul 25 10:13:37 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:13:37 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:13:37 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:13:37 user nova-compute[71312]:   </os>
Jul 25 10:13:37 user nova-compute[71312]:   <features>
Jul 25 10:13:37 user nova-compute[71312]:     <acpi/>
Jul 25 10:13:37 user nova-compute[71312]:     <apic/>
Jul 25 10:13:37 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:13:37 user nova-compute[71312]:   </features>
Jul 25 10:13:37 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:13:37 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:13:37 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:13:37 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:13:37 user nova-compute[71312]:   </clock>
Jul 25 10:13:37 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:13:37 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:13:37 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:13:37 user nova-compute[71312]:   </cpu>
Jul 25 10:13:37 user nova-compute[71312]:   <devices>
Jul 25 10:13:37 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:13:37 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:13:37 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/disk"/>
Jul 25 10:13:37 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:13:37 user nova-compute[71312]:     </disk>
Jul 25 10:13:37 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:13:37 user nova-compute[71312]:       <mac address="fa:16:3e:f3:17:58"/>
Jul 25 10:13:37 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:13:37 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:13:37 user nova-compute[71312]:       <target dev="tap7040a661-8a"/>
Jul 25 10:13:37 user nova-compute[71312]:     </interface>
Jul 25 10:13:37 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:13:37 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/console.log" append="off"/>
Jul 25 10:13:37 user nova-compute[71312]:     </serial>
Jul 25 10:13:37 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:13:37 user nova-compute[71312]:     <video>
Jul 25 10:13:37 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:13:37 user nova-compute[71312]:     </video>
Jul 25 10:13:37 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:13:37 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:13:37 user nova-compute[71312]:     </rng>
Jul 25 10:13:37 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:13:37 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:13:37 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:13:37 user nova-compute[71312]:     </memballoon>
Jul 25 10:13:37 user nova-compute[71312]:   </devices>
Jul 25 10:13:37 user nova-compute[71312]: </domain>
Jul 25 10:13:37 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-380768823',display_name='tempest-ServersNegativeTestJSON-server-380768823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-380768823',id=32,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e2222bf62bf487c911c811dbd8df8f1',ramdisk_id='',reservation_id='r-lajj6t21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-404227801',owner_user_name='tempest-ServersNegativeTestJSON-404227801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:13:35Z,user_data=None,user_id='3597b22f53c54e5ab63730caefea2369',uuid=59bade05-0eb7-4f92-ac8a-187865211d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "address": "fa:16:3e:f3:17:58", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7040a661-8a", "ovs_interfaceid": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Converting VIF {"id": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "address": "fa:16:3e:f3:17:58", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7040a661-8a", "ovs_interfaceid": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:17:58,bridge_name='br-int',has_traffic_filtering=True,id=7040a661-8a32-44a1-a85c-cb15f43c6e37,network=Network(44edfeb7-92a1-4284-ae77-c7d1e351aa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7040a661-8a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG os_vif [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:17:58,bridge_name='br-int',has_traffic_filtering=True,id=7040a661-8a32-44a1-a85c-cb15f43c6e37,network=Network(44edfeb7-92a1-4284-ae77-c7d1e351aa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7040a661-8a') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7040a661-8a, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7040a661-8a, col_values=(('external_ids', {'iface-id': '7040a661-8a32-44a1-a85c-cb15f43c6e37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:17:58', 'vm-uuid': '59bade05-0eb7-4f92-ac8a-187865211d4f'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:37 user nova-compute[71312]: INFO os_vif [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:17:58,bridge_name='br-int',has_traffic_filtering=True,id=7040a661-8a32-44a1-a85c-cb15f43c6e37,network=Network(44edfeb7-92a1-4284-ae77-c7d1e351aa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7040a661-8a')
Jul 25 10:13:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] No VIF found with MAC fa:16:3e:f3:17:58, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-6bec85b6-f1aa-418a-81da-82f78e794f91 req-2d8e70e3-2d77-4e1f-bd29-7ed0c5961d7d service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Updated VIF entry in instance network info cache for port 7040a661-8a32-44a1-a85c-cb15f43c6e37. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-6bec85b6-f1aa-418a-81da-82f78e794f91 req-2d8e70e3-2d77-4e1f-bd29-7ed0c5961d7d service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Updating instance_info_cache with network_info: [{"id": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "address": "fa:16:3e:f3:17:58", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7040a661-8a", "ovs_interfaceid": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:13:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6bec85b6-f1aa-418a-81da-82f78e794f91 req-2d8e70e3-2d77-4e1f-bd29-7ed0c5961d7d service nova] Releasing lock "refresh_cache-59bade05-0eb7-4f92-ac8a-187865211d4f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:13:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-1f903a95-c892-4c72-a230-bf0ea9ced55c req-c81b87a9-ea36-4b34-ba94-31c285a6f8de service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Received event network-vif-plugged-7040a661-8a32-44a1-a85c-cb15f43c6e37 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:13:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1f903a95-c892-4c72-a230-bf0ea9ced55c req-c81b87a9-ea36-4b34-ba94-31c285a6f8de service nova] Acquiring lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1f903a95-c892-4c72-a230-bf0ea9ced55c req-c81b87a9-ea36-4b34-ba94-31c285a6f8de service nova] Lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1f903a95-c892-4c72-a230-bf0ea9ced55c req-c81b87a9-ea36-4b34-ba94-31c285a6f8de service nova] Lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-1f903a95-c892-4c72-a230-bf0ea9ced55c req-c81b87a9-ea36-4b34-ba94-31c285a6f8de service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] No waiting events found dispatching network-vif-plugged-7040a661-8a32-44a1-a85c-cb15f43c6e37 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:13:38 user nova-compute[71312]: WARNING nova.compute.manager [req-1f903a95-c892-4c72-a230-bf0ea9ced55c req-c81b87a9-ea36-4b34-ba94-31c285a6f8de service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Received unexpected event network-vif-plugged-7040a661-8a32-44a1-a85c-cb15f43c6e37 for instance with vm_state building and task_state spawning.
Jul 25 10:13:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nymjKYTp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:13:40 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:13:40 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:13:40 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[717f4243-a936-4f7b-a301-c343c62fa704]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:13:40 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3540c886-5fa5-4aa4-9e09-cc959e7bd987]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3] added
Jul 25 10:13:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[64290904-ceee-43cd-81ec-fc98e8609a74]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef9017d-ea3e-4119-a68d-36e5bf0e35a4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nymjKYTp {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nymjKYTp" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[03135407-028f-4d43-a505-424cc0028feb]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nymjKYTp'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[188369d2-0af6-4cfa-b4a0-ac88438ce0c1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[717d3dfb-2e5a-465a-8f01-74e33d5a5517]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b33303-c9c2-4dfa-a160-5cda5904d142]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3, portal: 172.16.0.220,3260]
Jul 25 10:13:40 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3, portal: 172.16.0.220,3260] successful.
Jul 25 10:13:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[612c15d3-c0c7-477e-9f4f-415192aec1a0]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f0e714-214f-4c1e-852e-dbadcbbe55c5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 (non-flash)
Jul 25 10:13:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] HCTL ('38', '-', '-', 0) found on session 39 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee88fb7-dcd3-47bf-ad6c-c0da385f921d]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nymjKYTp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280020.5441048, 59bade05-0eb7-4f92-ac8a-187865211d4f => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:13:40 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] VM Resumed (Lifecycle Event)
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:13:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Instance spawned successfully.
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:13:40 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280020.5459638, 59bade05-0eb7-4f92-ac8a-187865211d4f => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:13:40 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] VM Started (Lifecycle Event)
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:13:40 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:13:40 user nova-compute[71312]: INFO nova.compute.manager [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Took 6.08 seconds to spawn the instance on the hypervisor.
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-e139436a-49f0-4211-a19f-c9e2d9194da1 req-1a30044c-c9c1-40f8-b6f7-f42e8da3a915 service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Received event network-vif-plugged-7040a661-8a32-44a1-a85c-cb15f43c6e37 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e139436a-49f0-4211-a19f-c9e2d9194da1 req-1a30044c-c9c1-40f8-b6f7-f42e8da3a915 service nova] Acquiring lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e139436a-49f0-4211-a19f-c9e2d9194da1 req-1a30044c-c9c1-40f8-b6f7-f42e8da3a915 service nova] Lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e139436a-49f0-4211-a19f-c9e2d9194da1 req-1a30044c-c9c1-40f8-b6f7-f42e8da3a915 service nova] Lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-e139436a-49f0-4211-a19f-c9e2d9194da1 req-1a30044c-c9c1-40f8-b6f7-f42e8da3a915 service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] No waiting events found dispatching network-vif-plugged-7040a661-8a32-44a1-a85c-cb15f43c6e37 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:13:40 user nova-compute[71312]: WARNING nova.compute.manager [req-e139436a-49f0-4211-a19f-c9e2d9194da1 req-1a30044c-c9c1-40f8-b6f7-f42e8da3a915 service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Received unexpected event network-vif-plugged-7040a661-8a32-44a1-a85c-cb15f43c6e37 for instance with vm_state building and task_state spawning.
Jul 25 10:13:40 user nova-compute[71312]: INFO nova.compute.manager [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Took 6.92 seconds to build instance.
Jul 25 10:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc3a9c04-80a2-4644-8a22-c6c977318150 tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "59bade05-0eb7-4f92-ac8a-187865211d4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.024s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23764343663326232', 'path': '/dev/sdg'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:13:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764343663326232', 'path': '/dev/sdg'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:13:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lazy-loading 'flavor' on Instance uuid 59f4ee46-2dcc-4609-99a2-d3260be757f3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:13:41 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:13:41 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:13:41 user nova-compute[71312]:   <target dev="vdc" bus="virtio"/>
Jul 25 10:13:41 user nova-compute[71312]:   <serial>67b3bac3-4f75-49df-8645-26029a5123b3</serial>
Jul 25 10:13:41 user nova-compute[71312]: </disk>
Jul 25 10:13:41 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:13:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] No VIF found with MAC fa:16:3e:4e:aa:8e, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:13:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dcbc75f3-ee60-4403-be83-0ba662db4efd tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.580s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:42 user nova-compute[71312]: INFO nova.compute.manager [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Detaching volume 67b3bac3-4f75-49df-8645-26029a5123b3
Jul 25 10:13:42 user nova-compute[71312]: INFO nova.virt.block_device [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Attempting to driver detach volume 67b3bac3-4f75-49df-8645-26029a5123b3 from mountpoint /dev/vdc
Jul 25 10:13:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Attempting to detach device vdc from instance 59f4ee46-2dcc-4609-99a2-d3260be757f3 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:13:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:13:42 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:13:42 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:13:42 user nova-compute[71312]:   <target dev="vdc" bus="virtio"/>
Jul 25 10:13:42 user nova-compute[71312]:   <serial>67b3bac3-4f75-49df-8645-26029a5123b3</serial>
Jul 25 10:13:42 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 10:13:42 user nova-compute[71312]: </disk>
Jul 25 10:13:42 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:13:42 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Successfully detached device vdc from instance 59f4ee46-2dcc-4609-99a2-d3260be757f3 from the persistent domain config.
Jul 25 10:13:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 59f4ee46-2dcc-4609-99a2-d3260be757f3 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:13:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:13:42 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:13:42 user nova-compute[71312]:   <source dev="/dev/sdg"/>
Jul 25 10:13:42 user nova-compute[71312]:   <target dev="vdc" bus="virtio"/>
Jul 25 10:13:42 user nova-compute[71312]:   <serial>67b3bac3-4f75-49df-8645-26029a5123b3</serial>
Jul 25 10:13:42 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 10:13:42 user nova-compute[71312]: </disk>
Jul 25 10:13:42 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690280023.0143158, 59f4ee46-2dcc-4609-99a2-d3260be757f3 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 59f4ee46-2dcc-4609-99a2-d3260be757f3 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:13:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Successfully detached device vdc from instance 59f4ee46-2dcc-4609-99a2-d3260be757f3 from the live domain config.
Jul 25 10:13:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nymjKYTp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:13:43 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6333a5-15db-43a7-9452-2855f738ae42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:13:43 user nova-compute[71312]: No targets found.
Jul 25 10:13:43 user nova-compute[71312]: iSNS:
Jul 25 10:13:43 user nova-compute[71312]: No targets found.
Jul 25 10:13:43 user nova-compute[71312]: STATIC:
Jul 25 10:13:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:13:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987
Jul 25 10:13:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3
Jul 25 10:13:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24
Jul 25 10:13:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e
Jul 25 10:13:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577
Jul 25 10:13:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:13:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:13:43 user nova-compute[71312]: FIRMWARE:
Jul 25 10:13:43 user nova-compute[71312]: No targets found.
Jul 25 10:13:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:13:43 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:13:43 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[220cd7ba-16d5-4225-938e-8d32471db6c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25d31f7-86ee-4fc5-a164-3a02fba64592]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:43 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:43 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:43 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:43 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:13:43 user nova-compute[71312]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 (non-flash)
Jul 25 10:13:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:43 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:43 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:43 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:43 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:13:43 user nova-compute[71312]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 (non-flash)
Jul 25 10:13:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a87512d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3'): ({'sdg'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Removing single pathed devices sdg {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e37554c-755b-47ae-8603-f64e02ea1927]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e521ec26-21e8-4d3c-955c-4e4654457829]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Flushing IO for device /dev/sdg {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f5d697-e868-44b0-9922-32491bf5a9ce]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af653aa-a557-47b9-b350-a1cb4e04d801]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9cd0fa-97c2-45b9-b81b-fd055b3bc0f2]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[83feb861-04ec-4ab7-9374-fbcb1b1ae6e7]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3, portal: 172.16.0.220,3260]
Jul 25 10:13:43 user nova-compute[71312]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3, portal: 172.16.0.220,3260] successful.
Jul 25 10:13:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b3bac3-4f75-49df-8645-26029a5123b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf2ddb1-941a-4211-a54b-fea085974ef1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] <== disconnect_volume: return (345ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:13:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:13:44 user nova-compute[71312]: DEBUG nova.objects.instance [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lazy-loading 'flavor' on Instance uuid 59f4ee46-2dcc-4609-99a2-d3260be757f3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-79268eae-b227-4bb2-aca0-e716187eba31 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.789s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:13:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:13:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:13:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:13:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:55 user nova-compute[71312]: INFO nova.compute.manager [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Rescuing
Jul 25 10:13:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "refresh_cache-b8e398f8-9e73-4077-a773-fdd1e494d37f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:13:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquired lock "refresh_cache-b8e398f8-9e73-4077-a773-fdd1e494d37f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:13:55 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:13:56 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Updating instance_info_cache with network_info: [{"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:13:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Releasing lock "refresh_cache-b8e398f8-9e73-4077-a773-fdd1e494d37f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:13:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-24f397e7-40bc-4850-b7a2-b718c5fed38c req-af9e80a7-d236-4762-9de3-1282ba32e562 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-vif-unplugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:13:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24f397e7-40bc-4850-b7a2-b718c5fed38c req-af9e80a7-d236-4762-9de3-1282ba32e562 service nova] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24f397e7-40bc-4850-b7a2-b718c5fed38c req-af9e80a7-d236-4762-9de3-1282ba32e562 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24f397e7-40bc-4850-b7a2-b718c5fed38c req-af9e80a7-d236-4762-9de3-1282ba32e562 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-24f397e7-40bc-4850-b7a2-b718c5fed38c req-af9e80a7-d236-4762-9de3-1282ba32e562 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] No waiting events found dispatching network-vif-unplugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:13:56 user nova-compute[71312]: WARNING nova.compute.manager [req-24f397e7-40bc-4850-b7a2-b718c5fed38c req-af9e80a7-d236-4762-9de3-1282ba32e562 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received unexpected event network-vif-unplugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 for instance with vm_state active and task_state rescuing.
Jul 25 10:13:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:57 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Instance destroyed successfully.
Jul 25 10:13:57 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Attempting a stable device rescue
Jul 25 10:13:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71312) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 10:13:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 10:13:57 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Creating image(s)
Jul 25 10:13:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "/opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "/opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:57 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'trusted_certs' on Instance uuid b8e398f8-9e73-4077-a773-fdd1e494d37f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4.part --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG nova.virt.images [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] ed5fa1a6-9006-41b7-8331-a29f9f8ef147 was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4.part /opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4.part /opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4.converted" returned: 0 in 0.624s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-e7d22464-4934-444e-a9f1-c5349636dd68 req-d61e838f-2bf9-4e2c-a715-d2962dd34335 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e7d22464-4934-444e-a9f1-c5349636dd68 req-d61e838f-2bf9-4e2c-a715-d2962dd34335 service nova] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e7d22464-4934-444e-a9f1-c5349636dd68 req-d61e838f-2bf9-4e2c-a715-d2962dd34335 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e7d22464-4934-444e-a9f1-c5349636dd68 req-d61e838f-2bf9-4e2c-a715-d2962dd34335 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-e7d22464-4934-444e-a9f1-c5349636dd68 req-d61e838f-2bf9-4e2c-a715-d2962dd34335 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] No waiting events found dispatching network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:13:58 user nova-compute[71312]: WARNING nova.compute.manager [req-e7d22464-4934-444e-a9f1-c5349636dd68 req-d61e838f-2bf9-4e2c-a715-d2962dd34335 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received unexpected event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 for instance with vm_state active and task_state rescuing.
Jul 25 10:13:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4.converted --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.707s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4 --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4,backing_fmt=raw /opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/disk.rescue {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4,backing_fmt=raw /opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/disk.rescue" returned: 0 in 0.053s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'migration_context' on Instance uuid b8e398f8-9e73-4077-a773-fdd1e494d37f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Start _get_guest_xml network_info=[{"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "vif_mac": "fa:16:3e:9d:94:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ed5fa1a6-9006-41b7-8331-a29f9f8ef147', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'ae904e78-3da1-4d75-8929-34443caa14c3', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXVkBRZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'b8e398f8-9e73-4077-a773-fdd1e494d37f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e44ec3b2-0b4c-47ca-baa4-45cd5704cc24', 'serial': 'e44ec3b2-0b4c-47ca-baa4-45cd5704cc24'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'resources' on Instance uuid b8e398f8-9e73-4077-a773-fdd1e494d37f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'numa_topology' on Instance uuid b8e398f8-9e73-4077-a773-fdd1e494d37f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:59 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:13:59 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'vcpu_model' on Instance uuid b8e398f8-9e73-4077-a773-fdd1e494d37f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXVkBRZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:13:59 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:13:59 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:13:59 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "58a20181-bba3-43ad-bddc-a63abc7cf80a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "58a20181-bba3-43ad-bddc-a63abc7cf80a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cb1b1c-5d6b-4968-8b84-b9464e90b699]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IXVkBRZa\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 25 10:13:59 user nova-compute[71312]: node.name = iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24
Jul 25 10:13:59 user nova-compute[71312]: node.tpgt = -1
Jul 25 10:13:59 user nova-compute[71312]: node.startup = automatic
Jul 25 10:13:59 user nova-compute[71312]: node.leading_login = No
Jul 25 10:13:59 user nova-compute[71312]: iface.iscsi_ifacename = default
Jul 25 10:13:59 user nova-compute[71312]: iface.net_ifacename = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.ipaddress = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.prefix_len = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.hwaddress = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.transport_name = tcp
Jul 25 10:13:59 user nova-compute[71312]: iface.initiatorname = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.state = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.vlan_id = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.vlan_priority = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.vlan_state = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.iface_num = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.mtu = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.port = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.bootproto = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.subnet_mask = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.gateway = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.dhcp_alt_client_id_state = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.dhcp_alt_client_id = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.dhcp_dns = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.dhcp_learn_iqn = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.dhcp_req_vendor_id_state = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.dhcp_vendor_id_state = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.dhcp_vendor_id = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.dhcp_slp_da = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.fragmentation = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.gratuitous_arp = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.incoming_forwarding = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.tos_state = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.tos = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.ttl = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.delayed_ack = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.tcp_nagle = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.tcp_wsf_state = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.tcp_wsf = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.tcp_timer_scale = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.tcp_timestamp = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.redirect = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.def_task_mgmt_timeout = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.header_digest = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.data_digest = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.immediate_data = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.initial_r2t = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.data_seq_inorder = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.data_pdu_inorder = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.erl = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.max_receive_data_len = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.first_burst_len = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.max_outstanding_r2t = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.max_burst_len = 0
Jul 25 10:13:59 user nova-compute[71312]: iface.chap_auth = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.bidi_chap = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.strict_login_compliance = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.discovery_auth = <empty>
Jul 25 10:13:59 user nova-compute[71312]: iface.discovery_logout = <empty>
Jul 25 10:13:59 user nova-compute[71312]: node.discovery_address = <empty>
Jul 25 10:13:59 user nova-compute[71312]: node.discovery_port = 0
Jul 25 10:13:59 user nova-compute[71312]: node.discovery_type = static
Jul 25 10:13:59 user nova-compute[71312]: node.session.initial_cmdsn = 0
Jul 25 10:13:59 user nova-compute[71312]: node.session.initial_login_retry_max = 8
Jul 25 10:13:59 user nova-compute[71312]: node.session.xmit_thread_priority = -20
Jul 25 10:13:59 user nova-compute[71312]: node.session.cmds_max = 128
Jul 25 10:13:59 user nova-compute[71312]: node.session.queue_depth = 32
Jul 25 10:13:59 user nova-compute[71312]: node.session.nr_sessions = 1
Jul 25 10:13:59 user nova-compute[71312]: node.session.auth.authmethod = CHAP
Jul 25 10:13:59 user nova-compute[71312]: node.session.auth.username = IXVkBRZa
Jul 25 10:13:59 user nova-compute[71312]: node.session.auth.password = ***
Jul 25 10:13:59 user nova-compute[71312]: node.session.auth.username_in = <empty>
Jul 25 10:13:59 user nova-compute[71312]: node.session.auth.password_in = <empty>
Jul 25 10:13:59 user nova-compute[71312]: node.session.auth.chap_algs = MD5
Jul 25 10:13:59 user nova-compute[71312]: node.session.timeo.replacement_timeout = 120
Jul 25 10:13:59 user nova-compute[71312]: node.session.err_timeo.abort_timeout = 15
Jul 25 10:13:59 user nova-compute[71312]: node.session.err_timeo.lu_reset_timeout = 30
Jul 25 10:13:59 user nova-compute[71312]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 25 10:13:59 user nova-compute[71312]: node.session.err_timeo.host_reset_timeout = 60
Jul 25 10:13:59 user nova-compute[71312]: node.session.iscsi.FastAbort = Yes
Jul 25 10:13:59 user nova-compute[71312]: node.session.iscsi.InitialR2T = No
Jul 25 10:13:59 user nova-compute[71312]: node.session.iscsi.ImmediateData = Yes
Jul 25 10:13:59 user nova-compute[71312]: node.session.iscsi.FirstBurstLength = 262144
Jul 25 10:13:59 user nova-compute[71312]: node.session.iscsi.MaxBurstLength = 16776192
Jul 25 10:13:59 user nova-compute[71312]: node.session.iscsi.DefaultTime2Retain = 0
Jul 25 10:13:59 user nova-compute[71312]: node.session.iscsi.DefaultTime2Wait = 2
Jul 25 10:13:59 user nova-compute[71312]: node.session.iscsi.MaxConnections = 1
Jul 25 10:13:59 user nova-compute[71312]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 25 10:13:59 user nova-compute[71312]: node.session.iscsi.ERL = 0
Jul 25 10:13:59 user nova-compute[71312]: node.session.scan = manual
Jul 25 10:13:59 user nova-compute[71312]: node.session.reopen_max = 0
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].address = 172.16.0.220
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].port = 3260
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].startup = manual
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].tcp.window_size = 524288
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].tcp.type_of_service = 0
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].timeo.logout_timeout = 15
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].timeo.login_timeout = 15
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].timeo.auth_timeout = 45
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].timeo.noop_out_interval = 5
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].timeo.noop_out_timeout = 5
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].iscsi.HeaderDigest = None
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].iscsi.DataDigest = None
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].iscsi.IFMarker = No
Jul 25 10:13:59 user nova-compute[71312]: node.conn[0].iscsi.OFMarker = No
Jul 25 10:13:59 user nova-compute[71312]: # END RECORD
Jul 25 10:13:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:59 user nova-compute[71312]: INFO nova.compute.manager [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Terminating instance
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d1380d-a3f8-45c4-bba5-9aadc152d702]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a86252-b0fc-4963-bf73-b7716b737c03]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXVkBRZa {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXVkBRZa" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca911e9-4180-435d-b3b4-f47cca720bd6]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IXVkBRZa'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e944e1-db3c-4e35-a419-82be354e33d0]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5034821a-daf0-43bd-b7d1-992999c51f92]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:59 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:59 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:59 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:59 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:13:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:13:59 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:13:59 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:13:59 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:13:59 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:13:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.179s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] HCTL ('35', '0', '0', 0) found on session 33 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[818eb8ac-6d8c-4e55-938b-aa0659cc1a01]: (4, ('0 0 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Searching for a device in session 33 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXVkBRZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.206s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] <== connect_volume: return (208ms) {'type': 'block', 'scsi_wwn': '23564663265323336', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564663265323336', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:12:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-580576116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-580576116',id=28,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:12:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b14fcd7739f41eabc9e7120f5b58a08',ramdisk_id='',reservation_id='r-h0xu7vza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-13369838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:12:23Z,user_data=None,user_id='96d25383d4b6448da2d30479a26bfa0f',uuid=b8e398f8-9e73-4077-a773-fdd1e494d37f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "vif_mac": "fa:16:3e:9d:94:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converting VIF {"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "vif_mac": "fa:16:3e:9d:94:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=39f60d81-9344-4fc4-917d-aa4dc290a5e0,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f60d81-93') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'pci_devices' on Instance uuid b8e398f8-9e73-4077-a773-fdd1e494d37f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:13:59 user nova-compute[71312]:   <uuid>b8e398f8-9e73-4077-a773-fdd1e494d37f</uuid>
Jul 25 10:13:59 user nova-compute[71312]:   <name>instance-0000001c</name>
Jul 25 10:13:59 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:13:59 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:13:59 user nova-compute[71312]:   <metadata>
Jul 25 10:13:59 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:13:59 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:13:59 user nova-compute[71312]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-580576116</nova:name>
Jul 25 10:13:59 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:13:59</nova:creationTime>
Jul 25 10:13:59 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:13:59 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:13:59 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:13:59 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:13:59 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:13:59 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:13:59 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:13:59 user nova-compute[71312]:       <nova:owner>
Jul 25 10:13:59 user nova-compute[71312]:         <nova:user uuid="96d25383d4b6448da2d30479a26bfa0f">tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member</nova:user>
Jul 25 10:13:59 user nova-compute[71312]:         <nova:project uuid="0b14fcd7739f41eabc9e7120f5b58a08">tempest-ServerBootFromVolumeStableRescueTest-13369838</nova:project>
Jul 25 10:13:59 user nova-compute[71312]:       </nova:owner>
Jul 25 10:13:59 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:13:59 user nova-compute[71312]:       <nova:ports>
Jul 25 10:13:59 user nova-compute[71312]:         <nova:port uuid="39f60d81-9344-4fc4-917d-aa4dc290a5e0">
Jul 25 10:13:59 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 10:13:59 user nova-compute[71312]:         </nova:port>
Jul 25 10:13:59 user nova-compute[71312]:       </nova:ports>
Jul 25 10:13:59 user nova-compute[71312]:     </nova:instance>
Jul 25 10:13:59 user nova-compute[71312]:   </metadata>
Jul 25 10:13:59 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:13:59 user nova-compute[71312]:     <system>
Jul 25 10:13:59 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:13:59 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:13:59 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:13:59 user nova-compute[71312]:       <entry name="serial">b8e398f8-9e73-4077-a773-fdd1e494d37f</entry>
Jul 25 10:13:59 user nova-compute[71312]:       <entry name="uuid">b8e398f8-9e73-4077-a773-fdd1e494d37f</entry>
Jul 25 10:13:59 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:13:59 user nova-compute[71312]:     </system>
Jul 25 10:13:59 user nova-compute[71312]:   </sysinfo>
Jul 25 10:13:59 user nova-compute[71312]:   <os>
Jul 25 10:13:59 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:13:59 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:13:59 user nova-compute[71312]:   </os>
Jul 25 10:13:59 user nova-compute[71312]:   <features>
Jul 25 10:13:59 user nova-compute[71312]:     <acpi/>
Jul 25 10:13:59 user nova-compute[71312]:     <apic/>
Jul 25 10:13:59 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:13:59 user nova-compute[71312]:   </features>
Jul 25 10:13:59 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:13:59 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:13:59 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:13:59 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:13:59 user nova-compute[71312]:   </clock>
Jul 25 10:13:59 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:13:59 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:13:59 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:13:59 user nova-compute[71312]:   </cpu>
Jul 25 10:13:59 user nova-compute[71312]:   <devices>
Jul 25 10:13:59 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:13:59 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:13:59 user nova-compute[71312]:       <source dev="/dev/sdd"/>
Jul 25 10:13:59 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:13:59 user nova-compute[71312]:       <serial>e44ec3b2-0b4c-47ca-baa4-45cd5704cc24</serial>
Jul 25 10:13:59 user nova-compute[71312]:     </disk>
Jul 25 10:13:59 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:13:59 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:13:59 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/disk.rescue"/>
Jul 25 10:13:59 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Jul 25 10:13:59 user nova-compute[71312]:       <boot order="1"/>
Jul 25 10:13:59 user nova-compute[71312]:     </disk>
Jul 25 10:13:59 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:13:59 user nova-compute[71312]:       <mac address="fa:16:3e:9d:94:99"/>
Jul 25 10:13:59 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:13:59 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:13:59 user nova-compute[71312]:       <target dev="tap39f60d81-93"/>
Jul 25 10:13:59 user nova-compute[71312]:     </interface>
Jul 25 10:13:59 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:13:59 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/console.log" append="off"/>
Jul 25 10:13:59 user nova-compute[71312]:     </serial>
Jul 25 10:13:59 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:13:59 user nova-compute[71312]:     <video>
Jul 25 10:13:59 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:13:59 user nova-compute[71312]:     </video>
Jul 25 10:13:59 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:13:59 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:13:59 user nova-compute[71312]:     </rng>
Jul 25 10:13:59 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:13:59 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:13:59 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:13:59 user nova-compute[71312]:     </memballoon>
Jul 25 10:13:59 user nova-compute[71312]:   </devices>
Jul 25 10:13:59 user nova-compute[71312]: </domain>
Jul 25 10:13:59 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:13:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Instance destroyed successfully.
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] No VIF found with MAC fa:16:3e:9d:94:99, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-4f9def30-b809-4e2d-8cac-9971683222dd req-a3e18486-c1ee-4f2e-a418-19fc476e49da service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Received event network-vif-unplugged-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4f9def30-b809-4e2d-8cac-9971683222dd req-a3e18486-c1ee-4f2e-a418-19fc476e49da service nova] Acquiring lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4f9def30-b809-4e2d-8cac-9971683222dd req-a3e18486-c1ee-4f2e-a418-19fc476e49da service nova] Lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4f9def30-b809-4e2d-8cac-9971683222dd req-a3e18486-c1ee-4f2e-a418-19fc476e49da service nova] Lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-4f9def30-b809-4e2d-8cac-9971683222dd req-a3e18486-c1ee-4f2e-a418-19fc476e49da service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] No waiting events found dispatching network-vif-unplugged-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:13:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-4f9def30-b809-4e2d-8cac-9971683222dd req-a3e18486-c1ee-4f2e-a418-19fc476e49da service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Received event network-vif-unplugged-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:14:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Instance destroyed successfully.
Jul 25 10:14:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lazy-loading 'resources' on Instance uuid 58a20181-bba3-43ad-bddc-a63abc7cf80a {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-397547476',display_name='tempest-VolumesActionsTest-instance-397547476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-397547476',id=29,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b43f656906af4f9e99608f46026618dd',ramdisk_id='',reservation_id='r-ierq8b0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1049905673',owner_user_name='tempest-VolumesActionsTest-1049905673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:12:15Z,user_data=None,user_id='8ca2145682dd42388f078b2236c2a196',uuid=58a20181-bba3-43ad-bddc-a63abc7cf80a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "address": "fa:16:3e:09:12:99", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b9626-2d", "ovs_interfaceid": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Converting VIF {"id": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "address": "fa:16:3e:09:12:99", "network": {"id": "19db69ce-484c-42ca-932f-688f1da7f111", "bridge": "br-int", "label": "tempest-VolumesActionsTest-553932743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43f656906af4f9e99608f46026618dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b9626-2d", "ovs_interfaceid": "494b9626-2d1f-4ebb-a254-9bf8ad5a55c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:12:99,bridge_name='br-int',has_traffic_filtering=True,id=494b9626-2d1f-4ebb-a254-9bf8ad5a55c2,network=Network(19db69ce-484c-42ca-932f-688f1da7f111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b9626-2d') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG os_vif [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:12:99,bridge_name='br-int',has_traffic_filtering=True,id=494b9626-2d1f-4ebb-a254-9bf8ad5a55c2,network=Network(19db69ce-484c-42ca-932f-688f1da7f111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b9626-2d') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap494b9626-2d, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:00 user nova-compute[71312]: INFO os_vif [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:12:99,bridge_name='br-int',has_traffic_filtering=True,id=494b9626-2d1f-4ebb-a254-9bf8ad5a55c2,network=Network(19db69ce-484c-42ca-932f-688f1da7f111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b9626-2d')
Jul 25 10:14:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Deleting instance files /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a_del
Jul 25 10:14:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Deletion of /opt/stack/data/nova/instances/58a20181-bba3-43ad-bddc-a63abc7cf80a_del complete
Jul 25 10:14:00 user nova-compute[71312]: INFO nova.compute.manager [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Took 1.02 seconds to destroy the instance on the hypervisor.
Jul 25 10:14:00 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:14:00 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Took 0.53 seconds to deallocate network for instance.
Jul 25 10:14:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-481ed0a5-6e16-4738-8acc-d1b7af06cbbd req-4df4478c-ad56-4466-bab4-4f9c716ee5f0 service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Received event network-vif-deleted-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:00 user nova-compute[71312]: INFO nova.compute.manager [req-481ed0a5-6e16-4738-8acc-d1b7af06cbbd req-4df4478c-ad56-4466-bab4-4f9c716ee5f0 service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Neutron deleted interface 494b9626-2d1f-4ebb-a254-9bf8ad5a55c2; detaching it from the instance and deleting it from the info cache
Jul 25 10:14:00 user nova-compute[71312]: DEBUG nova.network.neutron [req-481ed0a5-6e16-4738-8acc-d1b7af06cbbd req-4df4478c-ad56-4466-bab4-4f9c716ee5f0 service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-481ed0a5-6e16-4738-8acc-d1b7af06cbbd req-4df4478c-ad56-4466-bab4-4f9c716ee5f0 service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Detach interface failed, port_id=494b9626-2d1f-4ebb-a254-9bf8ad5a55c2, reason: Instance 58a20181-bba3-43ad-bddc-a63abc7cf80a could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:01 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:14:01 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:14:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:01 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Deleted allocations for instance 58a20181-bba3-43ad-bddc-a63abc7cf80a
Jul 25 10:14:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2cb05cef-209a-4b85-8643-b13a520c9ea2 tempest-VolumesActionsTest-1049905673 tempest-VolumesActionsTest-1049905673-project-member] Lock "58a20181-bba3-43ad-bddc-a63abc7cf80a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.265s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-fbe94348-da9c-483f-8b2e-5cc7c18b8cda req-bd0e347a-667f-44ad-997b-cd359b327383 service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Received event network-vif-plugged-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fbe94348-da9c-483f-8b2e-5cc7c18b8cda req-bd0e347a-667f-44ad-997b-cd359b327383 service nova] Acquiring lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fbe94348-da9c-483f-8b2e-5cc7c18b8cda req-bd0e347a-667f-44ad-997b-cd359b327383 service nova] Lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fbe94348-da9c-483f-8b2e-5cc7c18b8cda req-bd0e347a-667f-44ad-997b-cd359b327383 service nova] Lock "58a20181-bba3-43ad-bddc-a63abc7cf80a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-fbe94348-da9c-483f-8b2e-5cc7c18b8cda req-bd0e347a-667f-44ad-997b-cd359b327383 service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] No waiting events found dispatching network-vif-plugged-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:14:01 user nova-compute[71312]: WARNING nova.compute.manager [req-fbe94348-da9c-483f-8b2e-5cc7c18b8cda req-bd0e347a-667f-44ad-997b-cd359b327383 service nova] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Received unexpected event network-vif-plugged-494b9626-2d1f-4ebb-a254-9bf8ad5a55c2 for instance with vm_state deleted and task_state None.
Jul 25 10:14:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-718ae1e6-2e25-4b61-a6d3-07a46dcb5732 req-5f3f7dd2-fd7e-4971-95e6-804888fc784c service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-718ae1e6-2e25-4b61-a6d3-07a46dcb5732 req-5f3f7dd2-fd7e-4971-95e6-804888fc784c service nova] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-718ae1e6-2e25-4b61-a6d3-07a46dcb5732 req-5f3f7dd2-fd7e-4971-95e6-804888fc784c service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-718ae1e6-2e25-4b61-a6d3-07a46dcb5732 req-5f3f7dd2-fd7e-4971-95e6-804888fc784c service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-718ae1e6-2e25-4b61-a6d3-07a46dcb5732 req-5f3f7dd2-fd7e-4971-95e6-804888fc784c service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] No waiting events found dispatching network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:14:02 user nova-compute[71312]: WARNING nova.compute.manager [req-718ae1e6-2e25-4b61-a6d3-07a46dcb5732 req-5f3f7dd2-fd7e-4971-95e6-804888fc784c service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received unexpected event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 for instance with vm_state active and task_state rescuing.
Jul 25 10:14:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-718ae1e6-2e25-4b61-a6d3-07a46dcb5732 req-5f3f7dd2-fd7e-4971-95e6-804888fc784c service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-718ae1e6-2e25-4b61-a6d3-07a46dcb5732 req-5f3f7dd2-fd7e-4971-95e6-804888fc784c service nova] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-718ae1e6-2e25-4b61-a6d3-07a46dcb5732 req-5f3f7dd2-fd7e-4971-95e6-804888fc784c service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-718ae1e6-2e25-4b61-a6d3-07a46dcb5732 req-5f3f7dd2-fd7e-4971-95e6-804888fc784c service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-718ae1e6-2e25-4b61-a6d3-07a46dcb5732 req-5f3f7dd2-fd7e-4971-95e6-804888fc784c service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] No waiting events found dispatching network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:14:02 user nova-compute[71312]: WARNING nova.compute.manager [req-718ae1e6-2e25-4b61-a6d3-07a46dcb5732 req-5f3f7dd2-fd7e-4971-95e6-804888fc784c service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received unexpected event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 for instance with vm_state active and task_state rescuing.
Jul 25 10:14:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Removed pending event for b8e398f8-9e73-4077-a773-fdd1e494d37f due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 10:14:03 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280043.3853676, b8e398f8-9e73-4077-a773-fdd1e494d37f => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:14:03 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] VM Resumed (Lifecycle Event)
Jul 25 10:14:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d5b342ee-5a16-4843-8601-146357866545 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:14:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:14:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:14:03 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 10:14:03 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280043.3890262, b8e398f8-9e73-4077-a773-fdd1e494d37f => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:14:03 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] VM Started (Lifecycle Event)
Jul 25 10:14:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:14:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:14:03 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 10:14:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "93f45579-3a72-4646-8d47-2f47217e7ead" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "93f45579-3a72-4646-8d47-2f47217e7ead" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:10 user nova-compute[71312]: INFO nova.compute.manager [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Terminating instance
Jul 25 10:14:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8bddcaa-2ed0-4799-8e77-c3e27bbf1c49 req-4c34a44b-15ce-475a-8793-2a3ea86428c2 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Received event network-vif-unplugged-f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8bddcaa-2ed0-4799-8e77-c3e27bbf1c49 req-4c34a44b-15ce-475a-8793-2a3ea86428c2 service nova] Acquiring lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8bddcaa-2ed0-4799-8e77-c3e27bbf1c49 req-4c34a44b-15ce-475a-8793-2a3ea86428c2 service nova] Lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8bddcaa-2ed0-4799-8e77-c3e27bbf1c49 req-4c34a44b-15ce-475a-8793-2a3ea86428c2 service nova] Lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8bddcaa-2ed0-4799-8e77-c3e27bbf1c49 req-4c34a44b-15ce-475a-8793-2a3ea86428c2 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] No waiting events found dispatching network-vif-unplugged-f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8bddcaa-2ed0-4799-8e77-c3e27bbf1c49 req-4c34a44b-15ce-475a-8793-2a3ea86428c2 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Received event network-vif-unplugged-f8788bc7-a010-4631-be89-f443cff123be for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:14:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Instance destroyed successfully.
Jul 25 10:14:10 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lazy-loading 'resources' on Instance uuid 93f45579-3a72-4646-8d47-2f47217e7ead {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1069638045',display_name='tempest-AttachVolumeNegativeTest-server-1069638045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1069638045',id=25,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsTFUaboyVgjV6hEqNLlndAZdkK+AXtQlktKocOF/oAqLTvu0h5ApeUm9YqPJcAsEcmG1YYRLBlL1cfGXLdv20pemb1UtZ/jI1pkWg24y49sgU8kwyfZOQJEkQcrKnMVQ==',key_name='tempest-keypair-29371605',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:11:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a09fcc394c945c2b843abf3df53cda6',ramdisk_id='',reservation_id='r-gt8w7ffd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1016049404',owner_user_name='tempest-AttachVolumeNegativeTest-1016049404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe1a69013de4b4dbcb98a35e48d8ee8',uuid=93f45579-3a72-4646-8d47-2f47217e7ead,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8788bc7-a010-4631-be89-f443cff123be", "address": "fa:16:3e:77:ff:1b", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8788bc7-a0", "ovs_interfaceid": "f8788bc7-a010-4631-be89-f443cff123be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converting VIF {"id": "f8788bc7-a010-4631-be89-f443cff123be", "address": "fa:16:3e:77:ff:1b", "network": {"id": "dac30e86-4d3b-4e04-ae4c-c68e0ec649e3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-42989260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a09fcc394c945c2b843abf3df53cda6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8788bc7-a0", "ovs_interfaceid": "f8788bc7-a010-4631-be89-f443cff123be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:ff:1b,bridge_name='br-int',has_traffic_filtering=True,id=f8788bc7-a010-4631-be89-f443cff123be,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8788bc7-a0') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG os_vif [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:ff:1b,bridge_name='br-int',has_traffic_filtering=True,id=f8788bc7-a010-4631-be89-f443cff123be,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8788bc7-a0') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8788bc7-a0, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:14:10 user nova-compute[71312]: INFO os_vif [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:ff:1b,bridge_name='br-int',has_traffic_filtering=True,id=f8788bc7-a010-4631-be89-f443cff123be,network=Network(dac30e86-4d3b-4e04-ae4c-c68e0ec649e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8788bc7-a0')
Jul 25 10:14:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Deleting instance files /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead_del
Jul 25 10:14:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Deletion of /opt/stack/data/nova/instances/93f45579-3a72-4646-8d47-2f47217e7ead_del complete
Jul 25 10:14:10 user nova-compute[71312]: INFO nova.compute.manager [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 25 10:14:10 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:14:10 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:14:11 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:14:11 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Took 0.89 seconds to deallocate network for instance.
Jul 25 10:14:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-1d56aff5-6e76-4068-82f9-599b923b7eee req-4df29f9b-7db3-448a-9648-5789e7ace0fe service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Received event network-vif-deleted-f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:11 user nova-compute[71312]: INFO nova.compute.manager [req-1d56aff5-6e76-4068-82f9-599b923b7eee req-4df29f9b-7db3-448a-9648-5789e7ace0fe service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Neutron deleted interface f8788bc7-a010-4631-be89-f443cff123be; detaching it from the instance and deleting it from the info cache
Jul 25 10:14:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-1d56aff5-6e76-4068-82f9-599b923b7eee req-4df29f9b-7db3-448a-9648-5789e7ace0fe service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:14:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-1d56aff5-6e76-4068-82f9-599b923b7eee req-4df29f9b-7db3-448a-9648-5789e7ace0fe service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Detach interface failed, port_id=f8788bc7-a010-4631-be89-f443cff123be, reason: Instance 93f45579-3a72-4646-8d47-2f47217e7ead could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:14:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:12 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:14:12 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:14:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:12 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Deleted allocations for instance 93f45579-3a72-4646-8d47-2f47217e7ead
Jul 25 10:14:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-71d90d57-15e8-46da-b534-2392e2484a32 req-500b2aee-2c4c-4254-9215-565dc832b833 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Received event network-vif-plugged-f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-71d90d57-15e8-46da-b534-2392e2484a32 req-500b2aee-2c4c-4254-9215-565dc832b833 service nova] Acquiring lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-71d90d57-15e8-46da-b534-2392e2484a32 req-500b2aee-2c4c-4254-9215-565dc832b833 service nova] Lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-71d90d57-15e8-46da-b534-2392e2484a32 req-500b2aee-2c4c-4254-9215-565dc832b833 service nova] Lock "93f45579-3a72-4646-8d47-2f47217e7ead-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-71d90d57-15e8-46da-b534-2392e2484a32 req-500b2aee-2c4c-4254-9215-565dc832b833 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] No waiting events found dispatching network-vif-plugged-f8788bc7-a010-4631-be89-f443cff123be {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:14:12 user nova-compute[71312]: WARNING nova.compute.manager [req-71d90d57-15e8-46da-b534-2392e2484a32 req-500b2aee-2c4c-4254-9215-565dc832b833 service nova] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Received unexpected event network-vif-plugged-f8788bc7-a010-4631-be89-f443cff123be for instance with vm_state deleted and task_state None.
Jul 25 10:14:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7bacd39a-150e-45c6-887f-3744183ca349 tempest-AttachVolumeNegativeTest-1016049404 tempest-AttachVolumeNegativeTest-1016049404-project-member] Lock "93f45579-3a72-4646-8d47-2f47217e7ead" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.417s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-41640aa3-d82b-4585-b2fa-18fce1c1ba76 req-bb9e1b9f-fbb5-458f-9eaa-6ac36e8f1978 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-changed-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-41640aa3-d82b-4585-b2fa-18fce1c1ba76 req-bb9e1b9f-fbb5-458f-9eaa-6ac36e8f1978 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Refreshing instance network info cache due to event network-changed-41f8981e-82cc-48ba-b87f-ff31cba61d8b. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:14:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-41640aa3-d82b-4585-b2fa-18fce1c1ba76 req-bb9e1b9f-fbb5-458f-9eaa-6ac36e8f1978 service nova] Acquiring lock "refresh_cache-e76c87fb-557c-4451-95c0-a55936db7e23" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:14:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-41640aa3-d82b-4585-b2fa-18fce1c1ba76 req-bb9e1b9f-fbb5-458f-9eaa-6ac36e8f1978 service nova] Acquired lock "refresh_cache-e76c87fb-557c-4451-95c0-a55936db7e23" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:14:14 user nova-compute[71312]: DEBUG nova.network.neutron [req-41640aa3-d82b-4585-b2fa-18fce1c1ba76 req-bb9e1b9f-fbb5-458f-9eaa-6ac36e8f1978 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Refreshing network info cache for port 41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:14:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:15 user nova-compute[71312]: DEBUG nova.network.neutron [req-41640aa3-d82b-4585-b2fa-18fce1c1ba76 req-bb9e1b9f-fbb5-458f-9eaa-6ac36e8f1978 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Updated VIF entry in instance network info cache for port 41f8981e-82cc-48ba-b87f-ff31cba61d8b. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:14:15 user nova-compute[71312]: DEBUG nova.network.neutron [req-41640aa3-d82b-4585-b2fa-18fce1c1ba76 req-bb9e1b9f-fbb5-458f-9eaa-6ac36e8f1978 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Updating instance_info_cache with network_info: [{"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:14:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-41640aa3-d82b-4585-b2fa-18fce1c1ba76 req-bb9e1b9f-fbb5-458f-9eaa-6ac36e8f1978 service nova] Releasing lock "refresh_cache-e76c87fb-557c-4451-95c0-a55936db7e23" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:14:15 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280040.1535711, 58a20181-bba3-43ad-bddc-a63abc7cf80a => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:14:15 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] VM Stopped (Lifecycle Event)
Jul 25 10:14:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ee3b4614-17ac-4216-8822-045fddc6a40d None None] [instance: 58a20181-bba3-43ad-bddc-a63abc7cf80a] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:14:15 user nova-compute[71312]: INFO nova.compute.manager [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Rebuilding instance
Jul 25 10:14:15 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lazy-loading 'trusted_certs' on Instance uuid e76c87fb-557c-4451-95c0-a55936db7e23 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:14:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:14:15 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lazy-loading 'pci_requests' on Instance uuid e76c87fb-557c-4451-95c0-a55936db7e23 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:14:15 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lazy-loading 'pci_devices' on Instance uuid e76c87fb-557c-4451-95c0-a55936db7e23 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:14:15 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lazy-loading 'resources' on Instance uuid e76c87fb-557c-4451-95c0-a55936db7e23 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:14:15 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lazy-loading 'migration_context' on Instance uuid e76c87fb-557c-4451-95c0-a55936db7e23 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:14:15 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71312) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 25 10:14:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-0031806f-d4f5-4d3e-85d3-55916ceb1fa5 req-f841bd55-c043-4e64-aef9-1f700230c0ac service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-unplugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0031806f-d4f5-4d3e-85d3-55916ceb1fa5 req-f841bd55-c043-4e64-aef9-1f700230c0ac service nova] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0031806f-d4f5-4d3e-85d3-55916ceb1fa5 req-f841bd55-c043-4e64-aef9-1f700230c0ac service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0031806f-d4f5-4d3e-85d3-55916ceb1fa5 req-f841bd55-c043-4e64-aef9-1f700230c0ac service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-0031806f-d4f5-4d3e-85d3-55916ceb1fa5 req-f841bd55-c043-4e64-aef9-1f700230c0ac service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] No waiting events found dispatching network-vif-unplugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:14:16 user nova-compute[71312]: WARNING nova.compute.manager [req-0031806f-d4f5-4d3e-85d3-55916ceb1fa5 req-f841bd55-c043-4e64-aef9-1f700230c0ac service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received unexpected event network-vif-unplugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b for instance with vm_state active and task_state rebuilding.
Jul 25 10:14:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Instance destroyed successfully.
Jul 25 10:14:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Instance destroyed successfully.
Jul 25 10:14:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1869219181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1094011526',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOWd3fzd0CLBpf9IhL2nBunrCBai3U02DsR9QKrW6DhoW0y6gyAQObjWGKKtEv/XOkSt3jn2QhST3YzQp8xbbQ124cTSUJNFnQ6Rp4fiY4+CAboj8PhwW/HaVG5jTylvw==',key_name='tempest-keypair-735273049',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:12:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8aa44925fd09496683b46b15f728e9ca',ramdisk_id='',reservation_id='r-l0ssij03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1599012039',owner_user_name='tempest-ServerActionsV293TestJSON-1599012039-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:14:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9b48294a6374f439d94cb121c01dca9',uuid=e76c87fb-557c-4451-95c0-a55936db7e23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converting VIF {"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:64:08,bridge_name='br-int',has_traffic_filtering=True,id=41f8981e-82cc-48ba-b87f-ff31cba61d8b,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f8981e-82') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_vif [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:64:08,bridge_name='br-int',has_traffic_filtering=True,id=41f8981e-82cc-48ba-b87f-ff31cba61d8b,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f8981e-82') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41f8981e-82, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:14:16 user nova-compute[71312]: INFO os_vif [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:64:08,bridge_name='br-int',has_traffic_filtering=True,id=41f8981e-82cc-48ba-b87f-ff31cba61d8b,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f8981e-82')
Jul 25 10:14:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCpnJYaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:14:16 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ff1288-acb8-4a40-99c0-dc8647c2fc71]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:14:16 user nova-compute[71312]: No targets found.
Jul 25 10:14:16 user nova-compute[71312]: iSNS:
Jul 25 10:14:16 user nova-compute[71312]: No targets found.
Jul 25 10:14:16 user nova-compute[71312]: STATIC:
Jul 25 10:14:16 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:14:16 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:14:16 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:14:16 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987
Jul 25 10:14:16 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:14:16 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:14:16 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24
Jul 25 10:14:16 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:14:16 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:14:16 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e
Jul 25 10:14:16 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:14:16 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:14:16 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577
Jul 25 10:14:16 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:14:16 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:14:16 user nova-compute[71312]: FIRMWARE:
Jul 25 10:14:16 user nova-compute[71312]: No targets found.
Jul 25 10:14:16 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:14:16 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:14:16 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[186dadca-ef6b-496c-88e1-180bbfbab525]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[987523d8-30a5-4bde-8c53-d47dba0ec8ce]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:14:16 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:14:16 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:14:16 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:14:16 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:14:16 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:14:16 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:14:16 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:14:16 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:14:16 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:14:16 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c01663b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577'): ({'sde'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Removing single pathed devices sde {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c68ccb-50bf-4241-adf6-7b56295b8671]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfa5225-74b0-452a-a2ae-cb5f83b79332]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Flushing IO for device /dev/sde {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af5c320-6e0c-4a13-8ce3-2aa457ea4256]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6910fa98-39b3-466a-891c-9800813e9a9a]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb5601f80-6dc5dfcb78cc1ec2', '/dev/disk/by-id/scsi-23664633564666362', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b5601f80') {{(pid=82549) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 10:14:16 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOb5601f80-6dc5dfcb78cc1ec2
Jul 25 10:14:16 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23664633564666362
Jul 25 10:14:16 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_b5601f80
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfe267b-81a0-4f5b-bb73-26275ffc7b85]: (4, None) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5162d2d3-93cc-4652-91c4-491ddd578641]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[51524c90-bd22-4ad8-a5a3-2b211bf8a4ff]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260]
Jul 25 10:14:16 user nova-compute[71312]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260] successful.
Jul 25 10:14:16 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5f0527-613b-4b9a-a17b-4ae539563a4c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] <== disconnect_volume: return (395ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:14:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:14:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Deleting instance files /opt/stack/data/nova/instances/e76c87fb-557c-4451-95c0-a55936db7e23_del
Jul 25 10:14:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Deletion of /opt/stack/data/nova/instances/e76c87fb-557c-4451-95c0-a55936db7e23_del complete
Jul 25 10:14:17 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance e76c87fb-557c-4451-95c0-a55936db7e23 could not be found.
Jul 25 10:14:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCpnJYaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:14:17 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 10:14:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbd6977-c013-434a-8724-def74ae13d1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:14:17 user nova-compute[71312]: No targets found.
Jul 25 10:14:17 user nova-compute[71312]: iSNS:
Jul 25 10:14:17 user nova-compute[71312]: No targets found.
Jul 25 10:14:17 user nova-compute[71312]: STATIC:
Jul 25 10:14:17 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:14:17 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:14:17 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:14:17 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987
Jul 25 10:14:17 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:14:17 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:14:17 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24
Jul 25 10:14:17 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:14:17 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:14:17 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e
Jul 25 10:14:17 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:14:17 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:14:17 user nova-compute[71312]: FIRMWARE:
Jul 25 10:14:17 user nova-compute[71312]: No targets found.
Jul 25 10:14:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:14:17 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:14:17 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[171429ac-c823-4f8f-8916-6aac7dd6f5de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e164a3-f176-4c9c-b732-d03594aa470f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:14:17 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:14:17 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:14:17 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:14:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:14:17 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:14:17 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:14:17 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:14:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c02595a0>, {}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Disconnecting from: [] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.091s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] <== disconnect_volume: return (93ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:14:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:14:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Preparing to wait for external event volume-reimaged-021e3404-c8a0-49c4-b976-7e9368b60577 {{(pid=71312) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 25 10:14:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-1c7899e2-aa63-4d6f-a025-9720e697c6ef req-62832bab-78a1-4367-8539-5edb5a28acca service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1c7899e2-aa63-4d6f-a025-9720e697c6ef req-62832bab-78a1-4367-8539-5edb5a28acca service nova] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1c7899e2-aa63-4d6f-a025-9720e697c6ef req-62832bab-78a1-4367-8539-5edb5a28acca service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1c7899e2-aa63-4d6f-a025-9720e697c6ef req-62832bab-78a1-4367-8539-5edb5a28acca service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-1c7899e2-aa63-4d6f-a025-9720e697c6ef req-62832bab-78a1-4367-8539-5edb5a28acca service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] No event matching network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b in dict_keys([('volume-reimaged', '021e3404-c8a0-49c4-b976-7e9368b60577')]) {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Jul 25 10:14:18 user nova-compute[71312]: WARNING nova.compute.manager [req-1c7899e2-aa63-4d6f-a025-9720e697c6ef req-62832bab-78a1-4367-8539-5edb5a28acca service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received unexpected event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b for instance with vm_state active and task_state rebuilding.
Jul 25 10:14:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:14:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:14:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:14:25 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280050.8656015, 93f45579-3a72-4646-8d47-2f47217e7ead => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:14:25 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] VM Stopped (Lifecycle Event)
Jul 25 10:14:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:14:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-812b254e-337f-45d5-8934-e9c4a2113ea8 None None] [instance: 93f45579-3a72-4646-8d47-2f47217e7ead] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:14:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:14:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:14:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 10:14:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:14:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:14:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:14:27 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lazy-loading 'info_cache' on Instance uuid 5823c859-058e-4b2f-91b0-0e4def11bebf {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:14:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Updating instance_info_cache with network_info: [{"id": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "address": "fa:16:3e:60:b3:44", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d07c46c-fb", "ovs_interfaceid": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:14:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-5823c859-058e-4b2f-91b0-0e4def11bebf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:14:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:14:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:14:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:14:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:14:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:14:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-699cdc52-9e64-4cb1-809a-f8da9b2a2f2b req-4248e152-ea13-40eb-a356-dd934aaf5cf2 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received event network-changed-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-699cdc52-9e64-4cb1-809a-f8da9b2a2f2b req-4248e152-ea13-40eb-a356-dd934aaf5cf2 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Refreshing instance network info cache due to event network-changed-a8db9b27-beab-4c26-a2d9-cc428589bf62. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:14:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-699cdc52-9e64-4cb1-809a-f8da9b2a2f2b req-4248e152-ea13-40eb-a356-dd934aaf5cf2 service nova] Acquiring lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:14:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-699cdc52-9e64-4cb1-809a-f8da9b2a2f2b req-4248e152-ea13-40eb-a356-dd934aaf5cf2 service nova] Acquired lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:14:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-699cdc52-9e64-4cb1-809a-f8da9b2a2f2b req-4248e152-ea13-40eb-a356-dd934aaf5cf2 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Refreshing network info cache for port a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:14:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-699cdc52-9e64-4cb1-809a-f8da9b2a2f2b req-4248e152-ea13-40eb-a356-dd934aaf5cf2 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Updated VIF entry in instance network info cache for port a8db9b27-beab-4c26-a2d9-cc428589bf62. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:14:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-699cdc52-9e64-4cb1-809a-f8da9b2a2f2b req-4248e152-ea13-40eb-a356-dd934aaf5cf2 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Updating instance_info_cache with network_info: [{"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:14:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:14:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-699cdc52-9e64-4cb1-809a-f8da9b2a2f2b req-4248e152-ea13-40eb-a356-dd934aaf5cf2 service nova] Releasing lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:14:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280056.5353992, e76c87fb-557c-4451-95c0-a55936db7e23 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:14:31 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] VM Stopped (Lifecycle Event)
Jul 25 10:14:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-476a2910-b447-4adb-99cd-ff81d0ddb9e2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:14:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:14:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:33 user nova-compute[71312]: INFO nova.compute.manager [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Detaching volume f69f81f2-787c-4b24-84b3-3b1c8963d987
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: INFO nova.virt.block_device [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Attempting to driver detach volume f69f81f2-787c-4b24-84b3-3b1c8963d987 from mountpoint /dev/vdb
Jul 25 10:14:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-c3e43c87-7915-420a-a8ed-d9c511f8f070 req-994445ad-4810-4025-95e6-98a20f87d20b service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event volume-reimaged-021e3404-c8a0-49c4-b976-7e9368b60577 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c3e43c87-7915-420a-a8ed-d9c511f8f070 req-994445ad-4810-4025-95e6-98a20f87d20b service nova] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c3e43c87-7915-420a-a8ed-d9c511f8f070 req-994445ad-4810-4025-95e6-98a20f87d20b service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c3e43c87-7915-420a-a8ed-d9c511f8f070 req-994445ad-4810-4025-95e6-98a20f87d20b service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-c3e43c87-7915-420a-a8ed-d9c511f8f070 req-994445ad-4810-4025-95e6-98a20f87d20b service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Processing event volume-reimaged-021e3404-c8a0-49c4-b976-7e9368b60577 {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10772}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Instance event wait completed in 14 seconds for volume-reimaged {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Attempting to detach device vdb from instance 59f4ee46-2dcc-4609-99a2-d3260be757f3 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:14:33 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:14:33 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:14:33 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:14:33 user nova-compute[71312]:   <serial>f69f81f2-787c-4b24-84b3-3b1c8963d987</serial>
Jul 25 10:14:33 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:14:33 user nova-compute[71312]: </disk>
Jul 25 10:14:33 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:14:33 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Successfully detached device vdb from instance 59f4ee46-2dcc-4609-99a2-d3260be757f3 from the persistent domain config.
Jul 25 10:14:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 59f4ee46-2dcc-4609-99a2-d3260be757f3 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:14:33 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:14:33 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Jul 25 10:14:33 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:14:33 user nova-compute[71312]:   <serial>f69f81f2-787c-4b24-84b3-3b1c8963d987</serial>
Jul 25 10:14:33 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:14:33 user nova-compute[71312]: </disk>
Jul 25 10:14:33 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:14:33 user nova-compute[71312]: INFO nova.virt.block_device [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Booting with volume 021e3404-c8a0-49c4-b976-7e9368b60577 at /dev/vda
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.utils [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43c52fa-d580-4a9d-b0c3-1aa1d8a8c96b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d900b5ff-f52c-4ff5-832a-f9eef00e79ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a250be5b-fba4-4948-9e24-cf6b35846996]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[809df10c-143e-4dc3-aaeb-d78931cca43c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:14:33 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4c17d4-b0b1-40c4-a7ac-58ea2653e2a2]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.utils [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Updating existing volume attachment record: eaa7d2d0-1b8c-4d6b-98ab-3902577b96c2 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690280073.6711683, 59f4ee46-2dcc-4609-99a2-d3260be757f3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 59f4ee46-2dcc-4609-99a2-d3260be757f3 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:14:33 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Successfully detached device vdb from instance 59f4ee46-2dcc-4609-99a2-d3260be757f3 from the live domain config.
Jul 25 10:14:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fIliAEBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:14:33 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79875c0-21c4-40e4-873c-1c30683b37b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:14:33 user nova-compute[71312]: No targets found.
Jul 25 10:14:33 user nova-compute[71312]: iSNS:
Jul 25 10:14:33 user nova-compute[71312]: No targets found.
Jul 25 10:14:33 user nova-compute[71312]: STATIC:
Jul 25 10:14:33 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:14:33 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:14:33 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:14:33 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987
Jul 25 10:14:33 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:14:33 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:14:33 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24
Jul 25 10:14:33 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:14:33 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:14:33 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e
Jul 25 10:14:33 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:14:33 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:14:33 user nova-compute[71312]: FIRMWARE:
Jul 25 10:14:33 user nova-compute[71312]: No targets found.
Jul 25 10:14:33 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:14:33 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:14:33 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa156cb-b7ab-4b0e-bba0-76650f73cfa0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9606b465-907d-461a-bb48-891458fbe3a4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:14:33 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:14:33 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:14:33 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:14:33 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:14:33 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:14:33 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:14:33 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 (non-flash)
Jul 25 10:14:33 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a864d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987'): ({'sdf'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Removing single pathed devices sdf {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b751ee6d-0b8b-4ef1-9318-c59ab9806a76]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eccadc-96ef-4827-9f5d-936cd80b32dc]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Flushing IO for device /dev/sdf {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[090b6b0e-a3f8-4622-8748-cef5de44eca3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d1e316-e636-4014-91a7-ad094f0106ad]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:33 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbb586a-7583-4f33-93b8-fb54177fee2f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b91ba4d-770f-41a1-9f9f-732565c3d7d6]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987, portal: 172.16.0.220,3260]
Jul 25 10:14:34 user nova-compute[71312]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987, portal: 172.16.0.220,3260] successful.
Jul 25 10:14:34 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69f81f2-787c-4b24-84b3-3b1c8963d987 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[14058ee0-2b8a-406f-8dbb-549f447281af]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.847s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] <== disconnect_volume: return (849ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:14:34 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:14:34 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7219MB free_disk=25.088878631591797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 2e01c123-09c0-4a29-abf0-727f61484747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 80e8cdf1-c86a-43aa-a66c-46af281187a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance cba49a3e-0ffe-4ea2-a956-bb41c178dd38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 59f4ee46-2dcc-4609-99a2-d3260be757f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f5aa6ae1-551a-4f51-a29f-14612f9b17e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b8e398f8-9e73-4077-a773-fdd1e494d37f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance e76c87fb-557c-4451-95c0-a55936db7e23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 93222ef6-cba1-4427-a573-5c60c718db6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 59bade05-0eb7-4f92-ac8a-187865211d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "93222ef6-cba1-4427-a573-5c60c718db6c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "93222ef6-cba1-4427-a573-5c60c718db6c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:34 user nova-compute[71312]: INFO nova.compute.manager [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Shelving
Jul 25 10:14:35 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:14:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:35 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:14:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:35 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:14:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.674s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lazy-loading 'flavor' on Instance uuid 59f4ee46-2dcc-4609-99a2-d3260be757f3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:14:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-f0846602-4869-417b-860c-0b46ed8ad3d0 req-f99f90eb-39cb-492c-9a29-bfd57e53fe7c service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received event network-vif-unplugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f0846602-4869-417b-860c-0b46ed8ad3d0 req-f99f90eb-39cb-492c-9a29-bfd57e53fe7c service nova] Acquiring lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f0846602-4869-417b-860c-0b46ed8ad3d0 req-f99f90eb-39cb-492c-9a29-bfd57e53fe7c service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f0846602-4869-417b-860c-0b46ed8ad3d0 req-f99f90eb-39cb-492c-9a29-bfd57e53fe7c service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-f0846602-4869-417b-860c-0b46ed8ad3d0 req-f99f90eb-39cb-492c-9a29-bfd57e53fe7c service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] No waiting events found dispatching network-vif-unplugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:14:35 user nova-compute[71312]: WARNING nova.compute.manager [req-f0846602-4869-417b-860c-0b46ed8ad3d0 req-f99f90eb-39cb-492c-9a29-bfd57e53fe7c service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received unexpected event network-vif-unplugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 for instance with vm_state active and task_state shelving.
Jul 25 10:14:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-504c9019-15d3-4a4a-b09a-b60c9c7a1c40 tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.366s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Instance destroyed successfully.
Jul 25 10:14:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Beginning cold snapshot process
Jul 25 10:14:36 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:14:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk /opt/stack/data/nova/instances/snapshots/tmpjo8g6hvt/19ad55c3edf0417698c4e1ee66cf5edb {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:14:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk /opt/stack/data/nova/instances/snapshots/tmpjo8g6hvt/19ad55c3edf0417698c4e1ee66cf5edb" returned: 0 in 0.374s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Snapshot extracted, beginning image upload
Jul 25 10:14:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-c1e1bb93-0ec6-4a27-8b7a-725e74b7aa4b req-7c0f137d-1699-41df-84d6-04c9c80ef956 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received event network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c1e1bb93-0ec6-4a27-8b7a-725e74b7aa4b req-7c0f137d-1699-41df-84d6-04c9c80ef956 service nova] Acquiring lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c1e1bb93-0ec6-4a27-8b7a-725e74b7aa4b req-7c0f137d-1699-41df-84d6-04c9c80ef956 service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c1e1bb93-0ec6-4a27-8b7a-725e74b7aa4b req-7c0f137d-1699-41df-84d6-04c9c80ef956 service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-c1e1bb93-0ec6-4a27-8b7a-725e74b7aa4b req-7c0f137d-1699-41df-84d6-04c9c80ef956 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] No waiting events found dispatching network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:14:37 user nova-compute[71312]: WARNING nova.compute.manager [req-c1e1bb93-0ec6-4a27-8b7a-725e74b7aa4b req-7c0f137d-1699-41df-84d6-04c9c80ef956 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received unexpected event network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 for instance with vm_state active and task_state shelving_image_uploading.
Jul 25 10:14:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Snapshot image upload complete
Jul 25 10:14:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:14:38 user nova-compute[71312]: INFO nova.compute.manager [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Shelve offloading
Jul 25 10:14:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Instance destroyed successfully.
Jul 25 10:14:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:14:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:14:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquired lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:14:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:14:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Updating instance_info_cache with network_info: [{"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:14:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Releasing lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:14:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Instance destroyed successfully.
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'resources' on Instance uuid 93222ef6-cba1-4427-a573-5c60c718db6c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-228881500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-228881500',id=31,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3sczLA5TKbRelOtXVy7Hu+NIHQiYpa4nIRDi8+uN/qpmvSpM06eC3ZMc4BnGKGdQ0gOA0/RlOXlsTKbDSS+wvNME5SfN19jMxh5OYgcmvDxupr9/mJ5883mO5uMk+UEA==',key_name='tempest-keypair-1429184951',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:12:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='23211f867d6049f5bb1901e03e8dc396',ramdisk_id='',reservation_id='r-zkfj7ysk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1954806993',owner_user_name='tempest-AttachVolumeShelveTestJSON-1954806993-project-member',shelved_at='2023-07-25T10:14:38.891492',shelved_host='user',shelved_image_id='426cf81a-c39a-4419-8fe8-a951889a0c61'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:14:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec3ee9c206b43448eb6479cad0b437c',uuid=93222ef6-cba1-4427-a573-5c60c718db6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converting VIF {"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:80:27,bridge_name='br-int',has_traffic_filtering=True,id=a8db9b27-beab-4c26-a2d9-cc428589bf62,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db9b27-be') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG os_vif [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:80:27,bridge_name='br-int',has_traffic_filtering=True,id=a8db9b27-beab-4c26-a2d9-cc428589bf62,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db9b27-be') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8db9b27-be, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-ddd9fcb3-dae0-441a-9b02-64d002677733 req-81bef8a1-0f64-4c1c-b874-6333de6090eb service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received event network-changed-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-ddd9fcb3-dae0-441a-9b02-64d002677733 req-81bef8a1-0f64-4c1c-b874-6333de6090eb service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Refreshing instance network info cache due to event network-changed-a8db9b27-beab-4c26-a2d9-cc428589bf62. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ddd9fcb3-dae0-441a-9b02-64d002677733 req-81bef8a1-0f64-4c1c-b874-6333de6090eb service nova] Acquiring lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ddd9fcb3-dae0-441a-9b02-64d002677733 req-81bef8a1-0f64-4c1c-b874-6333de6090eb service nova] Acquired lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-ddd9fcb3-dae0-441a-9b02-64d002677733 req-81bef8a1-0f64-4c1c-b874-6333de6090eb service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Refreshing network info cache for port a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:14:40 user nova-compute[71312]: INFO os_vif [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:80:27,bridge_name='br-int',has_traffic_filtering=True,id=a8db9b27-beab-4c26-a2d9-cc428589bf62,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db9b27-be')
Jul 25 10:14:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Deleting instance files /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c_del
Jul 25 10:14:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Deletion of /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c_del complete
Jul 25 10:14:40 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Deleted allocations for instance 93222ef6-cba1-4427-a573-5c60c718db6c
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'numa_topology' on Instance uuid 93222ef6-cba1-4427-a573-5c60c718db6c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-ddd9fcb3-dae0-441a-9b02-64d002677733 req-81bef8a1-0f64-4c1c-b874-6333de6090eb service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Updated VIF entry in instance network info cache for port a8db9b27-beab-4c26-a2d9-cc428589bf62. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-ddd9fcb3-dae0-441a-9b02-64d002677733 req-81bef8a1-0f64-4c1c-b874-6333de6090eb service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Updating instance_info_cache with network_info: [{"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa8db9b27-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ddd9fcb3-dae0-441a-9b02-64d002677733 req-81bef8a1-0f64-4c1c-b874-6333de6090eb service nova] Releasing lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c96d73e-7d0e-49a4-b2f6-3fb9230b8a17 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "93222ef6-cba1-4427-a573-5c60c718db6c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.791s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:14:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Creating image(s)
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Ensure instance console log exists: /opt/stack/data/nova/instances/e76c87fb-557c-4451-95c0-a55936db7e23/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Start _get_guest_xml network_info=[{"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'eaa7d2d0-1b8c-4d6b-98ab-3902577b96c2', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCpnJYaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e76c87fb-557c-4451-95c0-a55936db7e23', 'attached_at': '', 'detached_at': '', 'volume_id': '021e3404-c8a0-49c4-b976-7e9368b60577', 'serial': '021e3404-c8a0-49c4-b976-7e9368b60577'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:14:40 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 25 10:14:40 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lazy-loading 'vcpu_model' on Instance uuid e76c87fb-557c-4451-95c0-a55936db7e23 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCpnJYaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:14:40 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 10:14:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:14:40 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 10:14:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:14:40 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee874f58-fbaf-4fdc-8aed-361848ecaefd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:14:40 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2e76da-272d-418e-85c0-0d8791252768]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577] added
Jul 25 10:14:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12975ba-3ebf-4e21-96e0-6da3c839b6a3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f160ee3-47fe-4e5c-84b7-2296651c1c6c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:14:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCpnJYaw {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCpnJYaw" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6fcb5d-608e-4c2c-ae4e-393f779d4322]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cCpnJYaw'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5396022-94b1-4c99-9866-5528f16552f7]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7cfb08-92f4-4aef-9b81-8380d1b7285c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:14:41 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:14:41 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:14:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:14:41 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:14:41 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:14:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5c0596-bdfa-4a4e-b9be-740e08ccb52d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260]
Jul 25 10:14:41 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260] successful.
Jul 25 10:14:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f462c09-8979-44e0-8d73-80ab65973e81]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8a32f1-e1b1-43a4-806c-6a94a6a8c9e5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:14:41 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:14:41 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:14:41 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:14:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:14:41 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:14:41 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:14:41 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:14:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f8f599-862a-4a4f-aee0-2afd9610b12b]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:14:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCpnJYaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23664633564666362', 'path': '/dev/sde'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664633564666362', 'path': '/dev/sde'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1869219181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1094011526',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOWd3fzd0CLBpf9IhL2nBunrCBai3U02DsR9QKrW6DhoW0y6gyAQObjWGKKtEv/XOkSt3jn2QhST3YzQp8xbbQ124cTSUJNFnQ6Rp4fiY4+CAboj8PhwW/HaVG5jTylvw==',key_name='tempest-keypair-735273049',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:12:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8aa44925fd09496683b46b15f728e9ca',ramdisk_id='',reservation_id='r-l0ssij03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1599012039',owner_user_name='tempest-ServerActionsV293TestJSON-1599012039-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:14:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9b48294a6374f439d94cb121c01dca9',uuid=e76c87fb-557c-4451-95c0-a55936db7e23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converting VIF {"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:64:08,bridge_name='br-int',has_traffic_filtering=True,id=41f8981e-82cc-48ba-b87f-ff31cba61d8b,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f8981e-82') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:14:42 user nova-compute[71312]:   <uuid>e76c87fb-557c-4451-95c0-a55936db7e23</uuid>
Jul 25 10:14:42 user nova-compute[71312]:   <name>instance-0000001e</name>
Jul 25 10:14:42 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:14:42 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:14:42 user nova-compute[71312]:   <metadata>
Jul 25 10:14:42 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:14:42 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:14:42 user nova-compute[71312]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1869219181</nova:name>
Jul 25 10:14:42 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:14:40</nova:creationTime>
Jul 25 10:14:42 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:14:42 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:14:42 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:14:42 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:14:42 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:14:42 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:14:42 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:14:42 user nova-compute[71312]:       <nova:owner>
Jul 25 10:14:42 user nova-compute[71312]:         <nova:user uuid="c9b48294a6374f439d94cb121c01dca9">tempest-ServerActionsV293TestJSON-1599012039-project-member</nova:user>
Jul 25 10:14:42 user nova-compute[71312]:         <nova:project uuid="8aa44925fd09496683b46b15f728e9ca">tempest-ServerActionsV293TestJSON-1599012039</nova:project>
Jul 25 10:14:42 user nova-compute[71312]:       </nova:owner>
Jul 25 10:14:42 user nova-compute[71312]:       <nova:ports>
Jul 25 10:14:42 user nova-compute[71312]:         <nova:port uuid="41f8981e-82cc-48ba-b87f-ff31cba61d8b">
Jul 25 10:14:42 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 10:14:42 user nova-compute[71312]:         </nova:port>
Jul 25 10:14:42 user nova-compute[71312]:       </nova:ports>
Jul 25 10:14:42 user nova-compute[71312]:     </nova:instance>
Jul 25 10:14:42 user nova-compute[71312]:   </metadata>
Jul 25 10:14:42 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:14:42 user nova-compute[71312]:     <system>
Jul 25 10:14:42 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:14:42 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:14:42 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:14:42 user nova-compute[71312]:       <entry name="serial">e76c87fb-557c-4451-95c0-a55936db7e23</entry>
Jul 25 10:14:42 user nova-compute[71312]:       <entry name="uuid">e76c87fb-557c-4451-95c0-a55936db7e23</entry>
Jul 25 10:14:42 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:14:42 user nova-compute[71312]:     </system>
Jul 25 10:14:42 user nova-compute[71312]:   </sysinfo>
Jul 25 10:14:42 user nova-compute[71312]:   <os>
Jul 25 10:14:42 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:14:42 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:14:42 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:14:42 user nova-compute[71312]:   </os>
Jul 25 10:14:42 user nova-compute[71312]:   <features>
Jul 25 10:14:42 user nova-compute[71312]:     <acpi/>
Jul 25 10:14:42 user nova-compute[71312]:     <apic/>
Jul 25 10:14:42 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:14:42 user nova-compute[71312]:   </features>
Jul 25 10:14:42 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:14:42 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:14:42 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:14:42 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:14:42 user nova-compute[71312]:   </clock>
Jul 25 10:14:42 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:14:42 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:14:42 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:14:42 user nova-compute[71312]:   </cpu>
Jul 25 10:14:42 user nova-compute[71312]:   <devices>
Jul 25 10:14:42 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:14:42 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:14:42 user nova-compute[71312]:       <source dev="/dev/sde"/>
Jul 25 10:14:42 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:14:42 user nova-compute[71312]:       <serial>021e3404-c8a0-49c4-b976-7e9368b60577</serial>
Jul 25 10:14:42 user nova-compute[71312]:     </disk>
Jul 25 10:14:42 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:14:42 user nova-compute[71312]:       <mac address="fa:16:3e:3f:64:08"/>
Jul 25 10:14:42 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:14:42 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:14:42 user nova-compute[71312]:       <target dev="tap41f8981e-82"/>
Jul 25 10:14:42 user nova-compute[71312]:     </interface>
Jul 25 10:14:42 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:14:42 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/e76c87fb-557c-4451-95c0-a55936db7e23/console.log" append="off"/>
Jul 25 10:14:42 user nova-compute[71312]:     </serial>
Jul 25 10:14:42 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:14:42 user nova-compute[71312]:     <video>
Jul 25 10:14:42 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:14:42 user nova-compute[71312]:     </video>
Jul 25 10:14:42 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:14:42 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:14:42 user nova-compute[71312]:     </rng>
Jul 25 10:14:42 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:14:42 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:14:42 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:14:42 user nova-compute[71312]:     </memballoon>
Jul 25 10:14:42 user nova-compute[71312]:   </devices>
Jul 25 10:14:42 user nova-compute[71312]: </domain>
Jul 25 10:14:42 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1869219181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1094011526',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOWd3fzd0CLBpf9IhL2nBunrCBai3U02DsR9QKrW6DhoW0y6gyAQObjWGKKtEv/XOkSt3jn2QhST3YzQp8xbbQ124cTSUJNFnQ6Rp4fiY4+CAboj8PhwW/HaVG5jTylvw==',key_name='tempest-keypair-735273049',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:12:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8aa44925fd09496683b46b15f728e9ca',ramdisk_id='',reservation_id='r-l0ssij03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1599012039',owner_user_name='tempest-ServerActionsV293TestJSON-1599012039-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:14:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9b48294a6374f439d94cb121c01dca9',uuid=e76c87fb-557c-4451-95c0-a55936db7e23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converting VIF {"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:64:08,bridge_name='br-int',has_traffic_filtering=True,id=41f8981e-82cc-48ba-b87f-ff31cba61d8b,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f8981e-82') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG os_vif [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:64:08,bridge_name='br-int',has_traffic_filtering=True,id=41f8981e-82cc-48ba-b87f-ff31cba61d8b,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f8981e-82') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41f8981e-82, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41f8981e-82, col_values=(('external_ids', {'iface-id': '41f8981e-82cc-48ba-b87f-ff31cba61d8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:64:08', 'vm-uuid': 'e76c87fb-557c-4451-95c0-a55936db7e23'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:42 user nova-compute[71312]: INFO os_vif [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:64:08,bridge_name='br-int',has_traffic_filtering=True,id=41f8981e-82cc-48ba-b87f-ff31cba61d8b,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f8981e-82')
Jul 25 10:14:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:14:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] No VIF found with MAC fa:16:3e:3f:64:08, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:14:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-5ecb7fb0-450e-488c-a59c-f0d7cdd1f46a req-54a68c24-5ed8-489d-ba03-f63b5f9f4f3e service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5ecb7fb0-450e-488c-a59c-f0d7cdd1f46a req-54a68c24-5ed8-489d-ba03-f63b5f9f4f3e service nova] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5ecb7fb0-450e-488c-a59c-f0d7cdd1f46a req-54a68c24-5ed8-489d-ba03-f63b5f9f4f3e service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5ecb7fb0-450e-488c-a59c-f0d7cdd1f46a req-54a68c24-5ed8-489d-ba03-f63b5f9f4f3e service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-5ecb7fb0-450e-488c-a59c-f0d7cdd1f46a req-54a68c24-5ed8-489d-ba03-f63b5f9f4f3e service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] No waiting events found dispatching network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:14:43 user nova-compute[71312]: WARNING nova.compute.manager [req-5ecb7fb0-450e-488c-a59c-f0d7cdd1f46a req-54a68c24-5ed8-489d-ba03-f63b5f9f4f3e service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received unexpected event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b for instance with vm_state active and task_state rebuild_spawning.
Jul 25 10:14:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280085.5714273, e76c87fb-557c-4451-95c0-a55936db7e23 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:14:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] VM Resumed (Lifecycle Event)
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:14:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Instance spawned successfully.
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:14:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280085.572615, e76c87fb-557c-4451-95c0-a55936db7e23 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:14:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] VM Started (Lifecycle Event)
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:14:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 25 10:14:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71312) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 25 10:14:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c3e43c87-7915-420a-a8ed-d9c511f8f070 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.075s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-093478ae-274c-4f28-81eb-d91ef36237e4 req-239dabfe-951c-44f8-8a64-371466f175e7 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:14:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-093478ae-274c-4f28-81eb-d91ef36237e4 req-239dabfe-951c-44f8-8a64-371466f175e7 service nova] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:14:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-093478ae-274c-4f28-81eb-d91ef36237e4 req-239dabfe-951c-44f8-8a64-371466f175e7 service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:14:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-093478ae-274c-4f28-81eb-d91ef36237e4 req-239dabfe-951c-44f8-8a64-371466f175e7 service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:14:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-093478ae-274c-4f28-81eb-d91ef36237e4 req-239dabfe-951c-44f8-8a64-371466f175e7 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] No waiting events found dispatching network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:14:46 user nova-compute[71312]: WARNING nova.compute.manager [req-093478ae-274c-4f28-81eb-d91ef36237e4 req-239dabfe-951c-44f8-8a64-371466f175e7 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received unexpected event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b for instance with vm_state active and task_state None.
Jul 25 10:14:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:50 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280075.7702634, 93222ef6-cba1-4427-a573-5c60c718db6c => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:14:50 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] VM Stopped (Lifecycle Event)
Jul 25 10:14:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4b9d9ee9-5344-49e6-a180-e7d6bfc08cf3 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:14:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:14:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:01 user nova-compute[71312]: INFO nova.compute.manager [None req-28ad0258-6c3f-4251-87cd-e19cc061feb2 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Get console output
Jul 25 10:15:02 user nova-compute[71312]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 25 10:15:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:15:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:15:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:15:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:15:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:15:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:23 user nova-compute[71312]: INFO nova.compute.manager [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Terminating instance
Jul 25 10:15:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:15:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-d27a9656-3496-4c43-9110-7325a0cca4fe req-134ae2e9-2d9e-4016-b24c-665e2f8f49f3 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Received event network-vif-unplugged-9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d27a9656-3496-4c43-9110-7325a0cca4fe req-134ae2e9-2d9e-4016-b24c-665e2f8f49f3 service nova] Acquiring lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d27a9656-3496-4c43-9110-7325a0cca4fe req-134ae2e9-2d9e-4016-b24c-665e2f8f49f3 service nova] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d27a9656-3496-4c43-9110-7325a0cca4fe req-134ae2e9-2d9e-4016-b24c-665e2f8f49f3 service nova] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-d27a9656-3496-4c43-9110-7325a0cca4fe req-134ae2e9-2d9e-4016-b24c-665e2f8f49f3 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] No waiting events found dispatching network-vif-unplugged-9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-d27a9656-3496-4c43-9110-7325a0cca4fe req-134ae2e9-2d9e-4016-b24c-665e2f8f49f3 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Received event network-vif-unplugged-9064e662-791e-46c5-b2e4-4f849ebba931 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "59bade05-0eb7-4f92-ac8a-187865211d4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "59bade05-0eb7-4f92-ac8a-187865211d4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:24 user nova-compute[71312]: INFO nova.compute.manager [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Terminating instance
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:24 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Instance destroyed successfully.
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lazy-loading 'resources' on Instance uuid 59f4ee46-2dcc-4609-99a2-d3260be757f3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2114361647',display_name='tempest-TestServerVolumeAttachmentScenario-server-2114361647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2114361647',id=26,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0yDjV+pcdP4ho4hrfbzcTG2Q96C5vqVmn14gwjX3eNPcIKJ5FcZlLVHbsYNqgb+HWUjDocRYOB2ZmagwR0WEaZ2Tv0xgJyV6HatKkUlPPmeESBR60OBrHUP/e+JV1Okg==',key_name='tempest-keypair-851669920',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:11:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fbd5e7b5d6b4aa48bb91c435a296bbd',ramdisk_id='',reservation_id='r-0i8haldc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2136889903',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2136889903-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='973a55055ef24c5e92facf5f311bb5f0',uuid=59f4ee46-2dcc-4609-99a2-d3260be757f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9064e662-791e-46c5-b2e4-4f849ebba931", "address": "fa:16:3e:4e:aa:8e", "network": {"id": "8b90228d-c790-453e-9cd3-56aa4386ea58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1601377159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbd5e7b5d6b4aa48bb91c435a296bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9064e662-79", "ovs_interfaceid": "9064e662-791e-46c5-b2e4-4f849ebba931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Converting VIF {"id": "9064e662-791e-46c5-b2e4-4f849ebba931", "address": "fa:16:3e:4e:aa:8e", "network": {"id": "8b90228d-c790-453e-9cd3-56aa4386ea58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1601377159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbd5e7b5d6b4aa48bb91c435a296bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9064e662-79", "ovs_interfaceid": "9064e662-791e-46c5-b2e4-4f849ebba931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=9064e662-791e-46c5-b2e4-4f849ebba931,network=Network(8b90228d-c790-453e-9cd3-56aa4386ea58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9064e662-79') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG os_vif [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=9064e662-791e-46c5-b2e4-4f849ebba931,network=Network(8b90228d-c790-453e-9cd3-56aa4386ea58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9064e662-79') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9064e662-79, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:24 user nova-compute[71312]: INFO os_vif [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=9064e662-791e-46c5-b2e4-4f849ebba931,network=Network(8b90228d-c790-453e-9cd3-56aa4386ea58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9064e662-79')
Jul 25 10:15:24 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Deleting instance files /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3_del
Jul 25 10:15:24 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Deletion of /opt/stack/data/nova/instances/59f4ee46-2dcc-4609-99a2-d3260be757f3_del complete
Jul 25 10:15:24 user nova-compute[71312]: INFO nova.compute.manager [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 25 10:15:24 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-18f49f15-7c2b-419c-bc64-ce5d48249e76 req-9573a0e8-fc5c-4a04-82ba-657056ab3d55 service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Received event network-vif-unplugged-7040a661-8a32-44a1-a85c-cb15f43c6e37 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18f49f15-7c2b-419c-bc64-ce5d48249e76 req-9573a0e8-fc5c-4a04-82ba-657056ab3d55 service nova] Acquiring lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18f49f15-7c2b-419c-bc64-ce5d48249e76 req-9573a0e8-fc5c-4a04-82ba-657056ab3d55 service nova] Lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18f49f15-7c2b-419c-bc64-ce5d48249e76 req-9573a0e8-fc5c-4a04-82ba-657056ab3d55 service nova] Lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-18f49f15-7c2b-419c-bc64-ce5d48249e76 req-9573a0e8-fc5c-4a04-82ba-657056ab3d55 service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] No waiting events found dispatching network-vif-unplugged-7040a661-8a32-44a1-a85c-cb15f43c6e37 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-18f49f15-7c2b-419c-bc64-ce5d48249e76 req-9573a0e8-fc5c-4a04-82ba-657056ab3d55 service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Received event network-vif-unplugged-7040a661-8a32-44a1-a85c-cb15f43c6e37 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:24 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Instance destroyed successfully.
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.objects.instance [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lazy-loading 'resources' on Instance uuid 59bade05-0eb7-4f92-ac8a-187865211d4f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-380768823',display_name='tempest-ServersNegativeTestJSON-server-380768823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-380768823',id=32,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:13:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e2222bf62bf487c911c811dbd8df8f1',ramdisk_id='',reservation_id='r-lajj6t21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-404227801',owner_user_name='tempest-ServersNegativeTestJSON-404227801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:13:41Z,user_data=None,user_id='3597b22f53c54e5ab63730caefea2369',uuid=59bade05-0eb7-4f92-ac8a-187865211d4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "address": "fa:16:3e:f3:17:58", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7040a661-8a", "ovs_interfaceid": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Converting VIF {"id": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "address": "fa:16:3e:f3:17:58", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7040a661-8a", "ovs_interfaceid": "7040a661-8a32-44a1-a85c-cb15f43c6e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:17:58,bridge_name='br-int',has_traffic_filtering=True,id=7040a661-8a32-44a1-a85c-cb15f43c6e37,network=Network(44edfeb7-92a1-4284-ae77-c7d1e351aa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7040a661-8a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG os_vif [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:17:58,bridge_name='br-int',has_traffic_filtering=True,id=7040a661-8a32-44a1-a85c-cb15f43c6e37,network=Network(44edfeb7-92a1-4284-ae77-c7d1e351aa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7040a661-8a') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7040a661-8a, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:15:24 user nova-compute[71312]: INFO os_vif [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:17:58,bridge_name='br-int',has_traffic_filtering=True,id=7040a661-8a32-44a1-a85c-cb15f43c6e37,network=Network(44edfeb7-92a1-4284-ae77-c7d1e351aa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7040a661-8a')
Jul 25 10:15:24 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Deleting instance files /opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f_del
Jul 25 10:15:24 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Deletion of /opt/stack/data/nova/instances/59bade05-0eb7-4f92-ac8a-187865211d4f_del complete
Jul 25 10:15:24 user nova-compute[71312]: INFO nova.compute.manager [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Took 0.70 seconds to destroy the instance on the hypervisor.
Jul 25 10:15:24 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:15:24 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:15:25 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:15:25 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:15:25 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Took 1.06 seconds to deallocate network for instance.
Jul 25 10:15:25 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Took 0.68 seconds to deallocate network for instance.
Jul 25 10:15:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:25 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.695s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.684s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-f45a0c0b-dd4c-49e1-82a4-f44e839dc842 req-699a026e-85e5-43c4-93a0-d46e85e85308 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Received event network-vif-plugged-9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f45a0c0b-dd4c-49e1-82a4-f44e839dc842 req-699a026e-85e5-43c4-93a0-d46e85e85308 service nova] Acquiring lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f45a0c0b-dd4c-49e1-82a4-f44e839dc842 req-699a026e-85e5-43c4-93a0-d46e85e85308 service nova] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f45a0c0b-dd4c-49e1-82a4-f44e839dc842 req-699a026e-85e5-43c4-93a0-d46e85e85308 service nova] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-f45a0c0b-dd4c-49e1-82a4-f44e839dc842 req-699a026e-85e5-43c4-93a0-d46e85e85308 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] No waiting events found dispatching network-vif-plugged-9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:15:26 user nova-compute[71312]: WARNING nova.compute.manager [req-f45a0c0b-dd4c-49e1-82a4-f44e839dc842 req-699a026e-85e5-43c4-93a0-d46e85e85308 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Received unexpected event network-vif-plugged-9064e662-791e-46c5-b2e4-4f849ebba931 for instance with vm_state deleted and task_state None.
Jul 25 10:15:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-f45a0c0b-dd4c-49e1-82a4-f44e839dc842 req-699a026e-85e5-43c4-93a0-d46e85e85308 service nova] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Received event network-vif-deleted-9064e662-791e-46c5-b2e4-4f849ebba931 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:15:26 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Deleted allocations for instance 59f4ee46-2dcc-4609-99a2-d3260be757f3
Jul 25 10:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6238f197-c692-4e7a-ba97-50bd3ae57f2b tempest-TestServerVolumeAttachmentScenario-2136889903 tempest-TestServerVolumeAttachmentScenario-2136889903-project-member] Lock "59f4ee46-2dcc-4609-99a2-d3260be757f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.037s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-4860e9aa-f279-4b68-94b2-2fde823e1fa3 req-8226c245-e275-4036-91c0-adfe8404ffc3 service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Received event network-vif-plugged-7040a661-8a32-44a1-a85c-cb15f43c6e37 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4860e9aa-f279-4b68-94b2-2fde823e1fa3 req-8226c245-e275-4036-91c0-adfe8404ffc3 service nova] Acquiring lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4860e9aa-f279-4b68-94b2-2fde823e1fa3 req-8226c245-e275-4036-91c0-adfe8404ffc3 service nova] Lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4860e9aa-f279-4b68-94b2-2fde823e1fa3 req-8226c245-e275-4036-91c0-adfe8404ffc3 service nova] Lock "59bade05-0eb7-4f92-ac8a-187865211d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-4860e9aa-f279-4b68-94b2-2fde823e1fa3 req-8226c245-e275-4036-91c0-adfe8404ffc3 service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] No waiting events found dispatching network-vif-plugged-7040a661-8a32-44a1-a85c-cb15f43c6e37 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:15:26 user nova-compute[71312]: WARNING nova.compute.manager [req-4860e9aa-f279-4b68-94b2-2fde823e1fa3 req-8226c245-e275-4036-91c0-adfe8404ffc3 service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Received unexpected event network-vif-plugged-7040a661-8a32-44a1-a85c-cb15f43c6e37 for instance with vm_state deleted and task_state None.
Jul 25 10:15:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-4860e9aa-f279-4b68-94b2-2fde823e1fa3 req-8226c245-e275-4036-91c0-adfe8404ffc3 service nova] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Received event network-vif-deleted-7040a661-8a32-44a1-a85c-cb15f43c6e37 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:26 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Deleted allocations for instance 59bade05-0eb7-4f92-ac8a-187865211d4f
Jul 25 10:15:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-71615f7c-441d-4ddb-bddd-2fc14fd7fc3e tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "59bade05-0eb7-4f92-ac8a-187865211d4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.919s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:15:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:15:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:15:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:15:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:15:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updating instance_info_cache with network_info: [{"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:15:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-bcc93774-32b0-4592-bf6a-d655bac21d39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:15:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:15:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:15:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:15:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:15:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:15:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:15:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:15:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:15:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:15:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:15:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:15:33 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:15:33 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:15:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7590MB free_disk=25.129825592041016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 2e01c123-09c0-4a29-abf0-727f61484747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 80e8cdf1-c86a-43aa-a66c-46af281187a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance cba49a3e-0ffe-4ea2-a956-bb41c178dd38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f5aa6ae1-551a-4f51-a29f-14612f9b17e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b8e398f8-9e73-4077-a773-fdd1e494d37f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance e76c87fb-557c-4451-95c0-a55936db7e23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:15:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:15:34 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:15:34 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:15:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:15:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:15:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Acquiring lock "51dc74c6-c677-4e31-b537-8d9507118520" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "51dc74c6-c677-4e31-b537-8d9507118520" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:15:38 user nova-compute[71312]: INFO nova.compute.claims [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Claim successful on node user
Jul 25 10:15:38 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:15:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:15:38 user nova-compute[71312]: DEBUG nova.policy [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ba662e4b3ba4e46857d4e2fa9f2bc86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f572a6a185244889965c370562a0339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:15:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Creating image(s)
Jul 25 10:15:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Acquiring lock "/opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "/opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "/opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/disk 1073741824" returned: 0 in 0.059s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280124.2849202, 59f4ee46-2dcc-4609-99a2-d3260be757f3 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:15:39 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] VM Stopped (Lifecycle Event)
Jul 25 10:15:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ca98bcc3-4154-455e-b77f-89ccf5ae889f None None] [instance: 59f4ee46-2dcc-4609-99a2-d3260be757f3] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.170s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Successfully created port: aa64f217-e75c-4107-9673-0ceeccf1cc6b {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Cannot resize image /opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG nova.objects.instance [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lazy-loading 'migration_context' on Instance uuid 51dc74c6-c677-4e31-b537-8d9507118520 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Ensure instance console log exists: /opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280124.6710608, 59bade05-0eb7-4f92-ac8a-187865211d4f => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:15:39 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] VM Stopped (Lifecycle Event)
Jul 25 10:15:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4a5a77d0-40c1-4f11-b79a-03f8ec211901 None None] [instance: 59bade05-0eb7-4f92-ac8a-187865211d4f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:15:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Successfully updated port: aa64f217-e75c-4107-9673-0ceeccf1cc6b {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:15:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Acquiring lock "refresh_cache-51dc74c6-c677-4e31-b537-8d9507118520" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:15:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Acquired lock "refresh_cache-51dc74c6-c677-4e31-b537-8d9507118520" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:15:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:15:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-8c53a357-b928-41d2-9e53-d2ac1b8e093f req-d96bef68-71e0-4b80-a01c-9d8a37cca1e3 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Received event network-changed-aa64f217-e75c-4107-9673-0ceeccf1cc6b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:15:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-8c53a357-b928-41d2-9e53-d2ac1b8e093f req-d96bef68-71e0-4b80-a01c-9d8a37cca1e3 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Refreshing instance network info cache due to event network-changed-aa64f217-e75c-4107-9673-0ceeccf1cc6b. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:15:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8c53a357-b928-41d2-9e53-d2ac1b8e093f req-d96bef68-71e0-4b80-a01c-9d8a37cca1e3 service nova] Acquiring lock "refresh_cache-51dc74c6-c677-4e31-b537-8d9507118520" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:15:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Updating instance_info_cache with network_info: [{"id": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "address": "fa:16:3e:7e:60:37", "network": {"id": "1133ac57-1fca-440d-b1c8-d90a64b1bca3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4c23af42fc11471fb11ccf88d9e96d71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa64f217-e7", "ovs_interfaceid": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Releasing lock "refresh_cache-51dc74c6-c677-4e31-b537-8d9507118520" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Instance network_info: |[{"id": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "address": "fa:16:3e:7e:60:37", "network": {"id": "1133ac57-1fca-440d-b1c8-d90a64b1bca3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4c23af42fc11471fb11ccf88d9e96d71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa64f217-e7", "ovs_interfaceid": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8c53a357-b928-41d2-9e53-d2ac1b8e093f req-d96bef68-71e0-4b80-a01c-9d8a37cca1e3 service nova] Acquired lock "refresh_cache-51dc74c6-c677-4e31-b537-8d9507118520" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-8c53a357-b928-41d2-9e53-d2ac1b8e093f req-d96bef68-71e0-4b80-a01c-9d8a37cca1e3 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Refreshing network info cache for port aa64f217-e75c-4107-9673-0ceeccf1cc6b {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Start _get_guest_xml network_info=[{"id": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "address": "fa:16:3e:7e:60:37", "network": {"id": "1133ac57-1fca-440d-b1c8-d90a64b1bca3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4c23af42fc11471fb11ccf88d9e96d71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa64f217-e7", "ovs_interfaceid": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:15:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:15:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1528653433',display_name='tempest-VolumesNegativeTest-instance-1528653433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1528653433',id=33,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f572a6a185244889965c370562a0339',ramdisk_id='',reservation_id='r-2u02jokr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-982996085',owner_user_name='tempest-VolumesNegativeTest-982996085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:15:39Z,user_data=None,user_id='3ba662e4b3ba4e46857d4e2fa9f2bc86',uuid=51dc74c6-c677-4e31-b537-8d9507118520,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "address": "fa:16:3e:7e:60:37", "network": {"id": "1133ac57-1fca-440d-b1c8-d90a64b1bca3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4c23af42fc11471fb11ccf88d9e96d71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa64f217-e7", "ovs_interfaceid": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Converting VIF {"id": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "address": "fa:16:3e:7e:60:37", "network": {"id": "1133ac57-1fca-440d-b1c8-d90a64b1bca3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4c23af42fc11471fb11ccf88d9e96d71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa64f217-e7", "ovs_interfaceid": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:60:37,bridge_name='br-int',has_traffic_filtering=True,id=aa64f217-e75c-4107-9673-0ceeccf1cc6b,network=Network(1133ac57-1fca-440d-b1c8-d90a64b1bca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa64f217-e7') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lazy-loading 'pci_devices' on Instance uuid 51dc74c6-c677-4e31-b537-8d9507118520 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:15:41 user nova-compute[71312]:   <uuid>51dc74c6-c677-4e31-b537-8d9507118520</uuid>
Jul 25 10:15:41 user nova-compute[71312]:   <name>instance-00000021</name>
Jul 25 10:15:41 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:15:41 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:15:41 user nova-compute[71312]:   <metadata>
Jul 25 10:15:41 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:15:41 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:15:41 user nova-compute[71312]:       <nova:name>tempest-VolumesNegativeTest-instance-1528653433</nova:name>
Jul 25 10:15:41 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:15:41</nova:creationTime>
Jul 25 10:15:41 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:15:41 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:15:41 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:15:41 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:15:41 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:15:41 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:15:41 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:15:41 user nova-compute[71312]:       <nova:owner>
Jul 25 10:15:41 user nova-compute[71312]:         <nova:user uuid="3ba662e4b3ba4e46857d4e2fa9f2bc86">tempest-VolumesNegativeTest-982996085-project-member</nova:user>
Jul 25 10:15:41 user nova-compute[71312]:         <nova:project uuid="9f572a6a185244889965c370562a0339">tempest-VolumesNegativeTest-982996085</nova:project>
Jul 25 10:15:41 user nova-compute[71312]:       </nova:owner>
Jul 25 10:15:41 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:15:41 user nova-compute[71312]:       <nova:ports>
Jul 25 10:15:41 user nova-compute[71312]:         <nova:port uuid="aa64f217-e75c-4107-9673-0ceeccf1cc6b">
Jul 25 10:15:41 user nova-compute[71312]:           <nova:ip type="fixed" address="192.168.233.124" ipVersion="4"/>
Jul 25 10:15:41 user nova-compute[71312]:         </nova:port>
Jul 25 10:15:41 user nova-compute[71312]:       </nova:ports>
Jul 25 10:15:41 user nova-compute[71312]:     </nova:instance>
Jul 25 10:15:41 user nova-compute[71312]:   </metadata>
Jul 25 10:15:41 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:15:41 user nova-compute[71312]:     <system>
Jul 25 10:15:41 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:15:41 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:15:41 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:15:41 user nova-compute[71312]:       <entry name="serial">51dc74c6-c677-4e31-b537-8d9507118520</entry>
Jul 25 10:15:41 user nova-compute[71312]:       <entry name="uuid">51dc74c6-c677-4e31-b537-8d9507118520</entry>
Jul 25 10:15:41 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:15:41 user nova-compute[71312]:     </system>
Jul 25 10:15:41 user nova-compute[71312]:   </sysinfo>
Jul 25 10:15:41 user nova-compute[71312]:   <os>
Jul 25 10:15:41 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:15:41 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:15:41 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:15:41 user nova-compute[71312]:   </os>
Jul 25 10:15:41 user nova-compute[71312]:   <features>
Jul 25 10:15:41 user nova-compute[71312]:     <acpi/>
Jul 25 10:15:41 user nova-compute[71312]:     <apic/>
Jul 25 10:15:41 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:15:41 user nova-compute[71312]:   </features>
Jul 25 10:15:41 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:15:41 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:15:41 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:15:41 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:15:41 user nova-compute[71312]:   </clock>
Jul 25 10:15:41 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:15:41 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:15:41 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:15:41 user nova-compute[71312]:   </cpu>
Jul 25 10:15:41 user nova-compute[71312]:   <devices>
Jul 25 10:15:41 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:15:41 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:15:41 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/disk"/>
Jul 25 10:15:41 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:15:41 user nova-compute[71312]:     </disk>
Jul 25 10:15:41 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:15:41 user nova-compute[71312]:       <mac address="fa:16:3e:7e:60:37"/>
Jul 25 10:15:41 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:15:41 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:15:41 user nova-compute[71312]:       <target dev="tapaa64f217-e7"/>
Jul 25 10:15:41 user nova-compute[71312]:     </interface>
Jul 25 10:15:41 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:15:41 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/console.log" append="off"/>
Jul 25 10:15:41 user nova-compute[71312]:     </serial>
Jul 25 10:15:41 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:15:41 user nova-compute[71312]:     <video>
Jul 25 10:15:41 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:15:41 user nova-compute[71312]:     </video>
Jul 25 10:15:41 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:15:41 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:15:41 user nova-compute[71312]:     </rng>
Jul 25 10:15:41 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:15:41 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:15:41 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:15:41 user nova-compute[71312]:     </memballoon>
Jul 25 10:15:41 user nova-compute[71312]:   </devices>
Jul 25 10:15:41 user nova-compute[71312]: </domain>
Jul 25 10:15:41 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1528653433',display_name='tempest-VolumesNegativeTest-instance-1528653433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1528653433',id=33,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f572a6a185244889965c370562a0339',ramdisk_id='',reservation_id='r-2u02jokr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-982996085',owner_user_name='tempest-VolumesNegativeTest-982996085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:15:39Z,user_data=None,user_id='3ba662e4b3ba4e46857d4e2fa9f2bc86',uuid=51dc74c6-c677-4e31-b537-8d9507118520,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "address": "fa:16:3e:7e:60:37", "network": {"id": "1133ac57-1fca-440d-b1c8-d90a64b1bca3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4c23af42fc11471fb11ccf88d9e96d71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa64f217-e7", "ovs_interfaceid": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Converting VIF {"id": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "address": "fa:16:3e:7e:60:37", "network": {"id": "1133ac57-1fca-440d-b1c8-d90a64b1bca3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4c23af42fc11471fb11ccf88d9e96d71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa64f217-e7", "ovs_interfaceid": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:60:37,bridge_name='br-int',has_traffic_filtering=True,id=aa64f217-e75c-4107-9673-0ceeccf1cc6b,network=Network(1133ac57-1fca-440d-b1c8-d90a64b1bca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa64f217-e7') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG os_vif [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:60:37,bridge_name='br-int',has_traffic_filtering=True,id=aa64f217-e75c-4107-9673-0ceeccf1cc6b,network=Network(1133ac57-1fca-440d-b1c8-d90a64b1bca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa64f217-e7') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa64f217-e7, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa64f217-e7, col_values=(('external_ids', {'iface-id': 'aa64f217-e75c-4107-9673-0ceeccf1cc6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:60:37', 'vm-uuid': '51dc74c6-c677-4e31-b537-8d9507118520'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:41 user nova-compute[71312]: INFO os_vif [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:60:37,bridge_name='br-int',has_traffic_filtering=True,id=aa64f217-e75c-4107-9673-0ceeccf1cc6b,network=Network(1133ac57-1fca-440d-b1c8-d90a64b1bca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa64f217-e7')
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] No VIF found with MAC fa:16:3e:7e:60:37, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-8c53a357-b928-41d2-9e53-d2ac1b8e093f req-d96bef68-71e0-4b80-a01c-9d8a37cca1e3 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Updated VIF entry in instance network info cache for port aa64f217-e75c-4107-9673-0ceeccf1cc6b. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-8c53a357-b928-41d2-9e53-d2ac1b8e093f req-d96bef68-71e0-4b80-a01c-9d8a37cca1e3 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Updating instance_info_cache with network_info: [{"id": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "address": "fa:16:3e:7e:60:37", "network": {"id": "1133ac57-1fca-440d-b1c8-d90a64b1bca3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4c23af42fc11471fb11ccf88d9e96d71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa64f217-e7", "ovs_interfaceid": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:15:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8c53a357-b928-41d2-9e53-d2ac1b8e093f req-d96bef68-71e0-4b80-a01c-9d8a37cca1e3 service nova] Releasing lock "refresh_cache-51dc74c6-c677-4e31-b537-8d9507118520" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:15:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-07bd3718-ab12-4df6-b7b2-8402aab8adf9 req-c760316d-4016-4ff5-829b-cd294bf624a6 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Received event network-vif-plugged-aa64f217-e75c-4107-9673-0ceeccf1cc6b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:15:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-07bd3718-ab12-4df6-b7b2-8402aab8adf9 req-c760316d-4016-4ff5-829b-cd294bf624a6 service nova] Acquiring lock "51dc74c6-c677-4e31-b537-8d9507118520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-07bd3718-ab12-4df6-b7b2-8402aab8adf9 req-c760316d-4016-4ff5-829b-cd294bf624a6 service nova] Lock "51dc74c6-c677-4e31-b537-8d9507118520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-07bd3718-ab12-4df6-b7b2-8402aab8adf9 req-c760316d-4016-4ff5-829b-cd294bf624a6 service nova] Lock "51dc74c6-c677-4e31-b537-8d9507118520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-07bd3718-ab12-4df6-b7b2-8402aab8adf9 req-c760316d-4016-4ff5-829b-cd294bf624a6 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] No waiting events found dispatching network-vif-plugged-aa64f217-e75c-4107-9673-0ceeccf1cc6b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:15:43 user nova-compute[71312]: WARNING nova.compute.manager [req-07bd3718-ab12-4df6-b7b2-8402aab8adf9 req-c760316d-4016-4ff5-829b-cd294bf624a6 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Received unexpected event network-vif-plugged-aa64f217-e75c-4107-9673-0ceeccf1cc6b for instance with vm_state building and task_state spawning.
Jul 25 10:15:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280145.094317, 51dc74c6-c677-4e31-b537-8d9507118520 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:15:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] VM Resumed (Lifecycle Event)
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:15:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Instance spawned successfully.
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:15:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280145.0952702, 51dc74c6-c677-4e31-b537-8d9507118520 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:15:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] VM Started (Lifecycle Event)
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:15:45 user nova-compute[71312]: INFO nova.compute.manager [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Took 6.46 seconds to spawn the instance on the hypervisor.
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:15:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:15:45 user nova-compute[71312]: INFO nova.compute.manager [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Took 7.25 seconds to build instance.
Jul 25 10:15:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-490d3b18-0d46-41d7-b1ec-d4784add646a tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "51dc74c6-c677-4e31-b537-8d9507118520" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.389s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-d5a45bde-2804-486e-874c-d53a4cc4e8a6 req-7d0c8c2b-23e1-44d8-8a14-8563c8ecfd52 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Received event network-vif-plugged-aa64f217-e75c-4107-9673-0ceeccf1cc6b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d5a45bde-2804-486e-874c-d53a4cc4e8a6 req-7d0c8c2b-23e1-44d8-8a14-8563c8ecfd52 service nova] Acquiring lock "51dc74c6-c677-4e31-b537-8d9507118520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d5a45bde-2804-486e-874c-d53a4cc4e8a6 req-7d0c8c2b-23e1-44d8-8a14-8563c8ecfd52 service nova] Lock "51dc74c6-c677-4e31-b537-8d9507118520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d5a45bde-2804-486e-874c-d53a4cc4e8a6 req-7d0c8c2b-23e1-44d8-8a14-8563c8ecfd52 service nova] Lock "51dc74c6-c677-4e31-b537-8d9507118520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-d5a45bde-2804-486e-874c-d53a4cc4e8a6 req-7d0c8c2b-23e1-44d8-8a14-8563c8ecfd52 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] No waiting events found dispatching network-vif-plugged-aa64f217-e75c-4107-9673-0ceeccf1cc6b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:15:45 user nova-compute[71312]: WARNING nova.compute.manager [req-d5a45bde-2804-486e-874c-d53a4cc4e8a6 req-7d0c8c2b-23e1-44d8-8a14-8563c8ecfd52 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Received unexpected event network-vif-plugged-aa64f217-e75c-4107-9673-0ceeccf1cc6b for instance with vm_state active and task_state None.
Jul 25 10:15:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:46 user nova-compute[71312]: INFO nova.compute.manager [None req-994a9dc5-9fc8-4991-b475-4e0bb3365aab tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Unrescuing
Jul 25 10:15:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-994a9dc5-9fc8-4991-b475-4e0bb3365aab tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "refresh_cache-b8e398f8-9e73-4077-a773-fdd1e494d37f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:15:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-994a9dc5-9fc8-4991-b475-4e0bb3365aab tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquired lock "refresh_cache-b8e398f8-9e73-4077-a773-fdd1e494d37f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:15:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-994a9dc5-9fc8-4991-b475-4e0bb3365aab tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:15:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-994a9dc5-9fc8-4991-b475-4e0bb3365aab tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Updating instance_info_cache with network_info: [{"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:15:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-994a9dc5-9fc8-4991-b475-4e0bb3365aab tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Releasing lock "refresh_cache-b8e398f8-9e73-4077-a773-fdd1e494d37f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:15:47 user nova-compute[71312]: DEBUG nova.objects.instance [None req-994a9dc5-9fc8-4991-b475-4e0bb3365aab tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'flavor' on Instance uuid b8e398f8-9e73-4077-a773-fdd1e494d37f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:15:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-30bcf3f0-5436-4496-9e9e-91cbb855c33b req-183cf12a-5767-4324-bb72-9fbcad441e95 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-vif-unplugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:15:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30bcf3f0-5436-4496-9e9e-91cbb855c33b req-183cf12a-5767-4324-bb72-9fbcad441e95 service nova] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30bcf3f0-5436-4496-9e9e-91cbb855c33b req-183cf12a-5767-4324-bb72-9fbcad441e95 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30bcf3f0-5436-4496-9e9e-91cbb855c33b req-183cf12a-5767-4324-bb72-9fbcad441e95 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-30bcf3f0-5436-4496-9e9e-91cbb855c33b req-183cf12a-5767-4324-bb72-9fbcad441e95 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] No waiting events found dispatching network-vif-unplugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:15:47 user nova-compute[71312]: WARNING nova.compute.manager [req-30bcf3f0-5436-4496-9e9e-91cbb855c33b req-183cf12a-5767-4324-bb72-9fbcad441e95 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received unexpected event network-vif-unplugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:15:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:48 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Instance destroyed successfully.
Jul 25 10:15:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-48585f48-4b1e-4ef7-9a78-7606e6b4741a req-f1265168-a575-4145-88e7-f50792cf5de7 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:15:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-48585f48-4b1e-4ef7-9a78-7606e6b4741a req-f1265168-a575-4145-88e7-f50792cf5de7 service nova] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-48585f48-4b1e-4ef7-9a78-7606e6b4741a req-f1265168-a575-4145-88e7-f50792cf5de7 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-48585f48-4b1e-4ef7-9a78-7606e6b4741a req-f1265168-a575-4145-88e7-f50792cf5de7 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-48585f48-4b1e-4ef7-9a78-7606e6b4741a req-f1265168-a575-4145-88e7-f50792cf5de7 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] No waiting events found dispatching network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:15:49 user nova-compute[71312]: WARNING nova.compute.manager [req-48585f48-4b1e-4ef7-9a78-7606e6b4741a req-f1265168-a575-4145-88e7-f50792cf5de7 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received unexpected event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:15:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-b425e6ae-534b-4f89-a5fc-fb1fe1d7c0c6 req-7f912d04-6036-46d8-b7b3-debeafeb6314 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:15:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b425e6ae-534b-4f89-a5fc-fb1fe1d7c0c6 req-7f912d04-6036-46d8-b7b3-debeafeb6314 service nova] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b425e6ae-534b-4f89-a5fc-fb1fe1d7c0c6 req-7f912d04-6036-46d8-b7b3-debeafeb6314 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b425e6ae-534b-4f89-a5fc-fb1fe1d7c0c6 req-7f912d04-6036-46d8-b7b3-debeafeb6314 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-b425e6ae-534b-4f89-a5fc-fb1fe1d7c0c6 req-7f912d04-6036-46d8-b7b3-debeafeb6314 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] No waiting events found dispatching network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:15:52 user nova-compute[71312]: WARNING nova.compute.manager [req-b425e6ae-534b-4f89-a5fc-fb1fe1d7c0c6 req-7f912d04-6036-46d8-b7b3-debeafeb6314 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received unexpected event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:15:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-b425e6ae-534b-4f89-a5fc-fb1fe1d7c0c6 req-7f912d04-6036-46d8-b7b3-debeafeb6314 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:15:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b425e6ae-534b-4f89-a5fc-fb1fe1d7c0c6 req-7f912d04-6036-46d8-b7b3-debeafeb6314 service nova] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:15:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b425e6ae-534b-4f89-a5fc-fb1fe1d7c0c6 req-7f912d04-6036-46d8-b7b3-debeafeb6314 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:15:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b425e6ae-534b-4f89-a5fc-fb1fe1d7c0c6 req-7f912d04-6036-46d8-b7b3-debeafeb6314 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:15:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-b425e6ae-534b-4f89-a5fc-fb1fe1d7c0c6 req-7f912d04-6036-46d8-b7b3-debeafeb6314 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] No waiting events found dispatching network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:15:52 user nova-compute[71312]: WARNING nova.compute.manager [req-b425e6ae-534b-4f89-a5fc-fb1fe1d7c0c6 req-7f912d04-6036-46d8-b7b3-debeafeb6314 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received unexpected event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:15:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-994a9dc5-9fc8-4991-b475-4e0bb3365aab tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:15:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Removed pending event for b8e398f8-9e73-4077-a773-fdd1e494d37f due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 10:15:52 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280152.102981, b8e398f8-9e73-4077-a773-fdd1e494d37f => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:15:52 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] VM Resumed (Lifecycle Event)
Jul 25 10:15:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:15:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:15:52 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280152.1115472, b8e398f8-9e73-4077-a773-fdd1e494d37f => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:15:52 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] VM Started (Lifecycle Event)
Jul 25 10:15:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:15:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:15:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:15:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:02 user nova-compute[71312]: INFO nova.compute.manager [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Terminating instance
Jul 25 10:16:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:16:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-56031d3e-33ba-4669-a4ec-ac69da957890 req-f2f8747f-6a42-488b-a55d-658d754045fb service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received event network-vif-unplugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-56031d3e-33ba-4669-a4ec-ac69da957890 req-f2f8747f-6a42-488b-a55d-658d754045fb service nova] Acquiring lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-56031d3e-33ba-4669-a4ec-ac69da957890 req-f2f8747f-6a42-488b-a55d-658d754045fb service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-56031d3e-33ba-4669-a4ec-ac69da957890 req-f2f8747f-6a42-488b-a55d-658d754045fb service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-56031d3e-33ba-4669-a4ec-ac69da957890 req-f2f8747f-6a42-488b-a55d-658d754045fb service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] No waiting events found dispatching network-vif-unplugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-56031d3e-33ba-4669-a4ec-ac69da957890 req-f2f8747f-6a42-488b-a55d-658d754045fb service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received event network-vif-unplugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:16:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Instance destroyed successfully.
Jul 25 10:16:03 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'resources' on Instance uuid cba49a3e-0ffe-4ea2-a956-bb41c178dd38 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-87945462',display_name='tempest-ServerActionsTestOtherA-server-87945462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-87945462',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7/PiN27E1zNONLGfU75gjTzl6TjLJTSPguo/w/NLGiNWvcFBQAXJk/RsZr2x3/TDzaN8UL9NG26qh75+qbwT35akc6FqjZaWZn3poJMiar+SGmPPXZDxAQP/CqYmNQIw==',key_name='tempest-keypair-2143034637',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:11:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c30d33a1a8945fdab6798c94a558444',ramdisk_id='',reservation_id='r-emt2yer0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-408585031',owner_user_name='tempest-ServerActionsTestOtherA-408585031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:13:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfdced66e34e0ba7f9437e71aaee6a',uuid=cba49a3e-0ffe-4ea2-a956-bb41c178dd38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converting VIF {"id": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "address": "fa:16:3e:39:2e:f4", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6bcfd4-34", "ovs_interfaceid": "7e6bcfd4-3491-4be2-819d-92ed4bed42f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:2e:f4,bridge_name='br-int',has_traffic_filtering=True,id=7e6bcfd4-3491-4be2-819d-92ed4bed42f7,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6bcfd4-34') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_vif [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:2e:f4,bridge_name='br-int',has_traffic_filtering=True,id=7e6bcfd4-3491-4be2-819d-92ed4bed42f7,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6bcfd4-34') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e6bcfd4-34, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:03 user nova-compute[71312]: INFO os_vif [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:2e:f4,bridge_name='br-int',has_traffic_filtering=True,id=7e6bcfd4-3491-4be2-819d-92ed4bed42f7,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6bcfd4-34')
Jul 25 10:16:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRHCGBOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:16:03 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0248cf5e-4a06-4d2f-bc3b-7d3c50be8d47]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:16:03 user nova-compute[71312]: No targets found.
Jul 25 10:16:03 user nova-compute[71312]: iSNS:
Jul 25 10:16:03 user nova-compute[71312]: No targets found.
Jul 25 10:16:03 user nova-compute[71312]: STATIC:
Jul 25 10:16:03 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:16:03 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:16:03 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:16:03 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24
Jul 25 10:16:03 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:16:03 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:16:03 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e
Jul 25 10:16:03 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:16:03 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:16:03 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577
Jul 25 10:16:03 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:16:03 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:16:03 user nova-compute[71312]: FIRMWARE:
Jul 25 10:16:03 user nova-compute[71312]: No targets found.
Jul 25 10:16:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:16:03 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:16:03 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0a5db0-29cc-47f2-a53f-272805ce71e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[964c8814-2d33-4d26-b69a-4cc9458300ad]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:16:03 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:16:03 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:16:03 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:16:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:16:03 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e (non-flash)
Jul 25 10:16:03 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:16:03 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:16:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a8630e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a20b82-a0b4-414d-932a-8bd291c259a5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19d37bc-bec8-4890-93a8-4ccc8b37b0d9]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf28a1b8-8855-47ae-9c9a-231409450602]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d56a23c-6d1b-4e12-a432-3cccd08dfc3f]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23466653362353862', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c30598cd', '/dev/disk/by-id/scsi-1SCST_BIOc30598cd-4fe3b58b00eab43b') {{(pid=82549) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b522333-852f-4777-9768-fc575d7f05d1]: (4, None) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa18e10-7ad3-415b-94be-e55c0cc8cdc8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb07bdd-ced7-477d-b85f-10abc44733a1]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260]
Jul 25 10:16:03 user nova-compute[71312]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e, portal: 172.16.0.220,3260] successful.
Jul 25 10:16:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81927262-7d9a-4a7e-b71b-c0508ba11c5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[56195c2e-0446-4bf9-8092-1ac2f87fd79c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] <== disconnect_volume: return (377ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:16:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:16:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Deleting instance files /opt/stack/data/nova/instances/cba49a3e-0ffe-4ea2-a956-bb41c178dd38_del
Jul 25 10:16:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Deletion of /opt/stack/data/nova/instances/cba49a3e-0ffe-4ea2-a956-bb41c178dd38_del complete
Jul 25 10:16:04 user nova-compute[71312]: INFO nova.compute.manager [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Took 1.30 seconds to destroy the instance on the hypervisor.
Jul 25 10:16:04 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:16:04 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:16:04 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:16:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-b4928d3f-615d-462d-8f49-f6920e36214f req-17d51d0f-1289-452d-918e-f942e59cdec0 service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received event network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b4928d3f-615d-462d-8f49-f6920e36214f req-17d51d0f-1289-452d-918e-f942e59cdec0 service nova] Acquiring lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b4928d3f-615d-462d-8f49-f6920e36214f req-17d51d0f-1289-452d-918e-f942e59cdec0 service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b4928d3f-615d-462d-8f49-f6920e36214f req-17d51d0f-1289-452d-918e-f942e59cdec0 service nova] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-b4928d3f-615d-462d-8f49-f6920e36214f req-17d51d0f-1289-452d-918e-f942e59cdec0 service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] No waiting events found dispatching network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:16:05 user nova-compute[71312]: WARNING nova.compute.manager [req-b4928d3f-615d-462d-8f49-f6920e36214f req-17d51d0f-1289-452d-918e-f942e59cdec0 service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received unexpected event network-vif-plugged-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 for instance with vm_state active and task_state deleting.
Jul 25 10:16:05 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:16:05 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Took 1.41 seconds to deallocate network for instance.
Jul 25 10:16:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:06 user nova-compute[71312]: INFO nova.compute.manager [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Took 0.81 seconds to detach 1 volumes for instance.
Jul 25 10:16:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Deleting volume: 81927262-7d9a-4a7e-b71b-c0508ba11c5e {{(pid=71312) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 10:16:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:06 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:16:06 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:16:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:06 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Deleted allocations for instance cba49a3e-0ffe-4ea2-a956-bb41c178dd38
Jul 25 10:16:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5b0ccae-982e-4ba6-8b91-dd5cb09640d4 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "cba49a3e-0ffe-4ea2-a956-bb41c178dd38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.212s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-1a7b6fe1-b651-4b04-a51b-0068469ed4a4 req-2d911781-d1cb-4aa6-a195-5e051abf5412 service nova] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Received event network-vif-deleted-7e6bcfd4-3491-4be2-819d-92ed4bed42f7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "e76c87fb-557c-4451-95c0-a55936db7e23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:07 user nova-compute[71312]: INFO nova.compute.manager [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Terminating instance
Jul 25 10:16:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:16:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8df4112-8690-4dad-8b78-89661cbc4634 req-02ab6539-9233-4a6a-9870-44f0a0909ee4 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-unplugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8df4112-8690-4dad-8b78-89661cbc4634 req-02ab6539-9233-4a6a-9870-44f0a0909ee4 service nova] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8df4112-8690-4dad-8b78-89661cbc4634 req-02ab6539-9233-4a6a-9870-44f0a0909ee4 service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8df4112-8690-4dad-8b78-89661cbc4634 req-02ab6539-9233-4a6a-9870-44f0a0909ee4 service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8df4112-8690-4dad-8b78-89661cbc4634 req-02ab6539-9233-4a6a-9870-44f0a0909ee4 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] No waiting events found dispatching network-vif-unplugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8df4112-8690-4dad-8b78-89661cbc4634 req-02ab6539-9233-4a6a-9870-44f0a0909ee4 service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-unplugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:08 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Instance destroyed successfully.
Jul 25 10:16:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lazy-loading 'resources' on Instance uuid e76c87fb-557c-4451-95c0-a55936db7e23 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1869219181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1094011526',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOWd3fzd0CLBpf9IhL2nBunrCBai3U02DsR9QKrW6DhoW0y6gyAQObjWGKKtEv/XOkSt3jn2QhST3YzQp8xbbQ124cTSUJNFnQ6Rp4fiY4+CAboj8PhwW/HaVG5jTylvw==',key_name='tempest-keypair-735273049',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8aa44925fd09496683b46b15f728e9ca',ramdisk_id='',reservation_id='r-l0ssij03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1599012039',owner_user_name='tempest-ServerActionsV293TestJSON-1599012039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9b48294a6374f439d94cb121c01dca9',uuid=e76c87fb-557c-4451-95c0-a55936db7e23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converting VIF {"id": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "address": "fa:16:3e:3f:64:08", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f8981e-82", "ovs_interfaceid": "41f8981e-82cc-48ba-b87f-ff31cba61d8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:64:08,bridge_name='br-int',has_traffic_filtering=True,id=41f8981e-82cc-48ba-b87f-ff31cba61d8b,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f8981e-82') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_vif [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:64:08,bridge_name='br-int',has_traffic_filtering=True,id=41f8981e-82cc-48ba-b87f-ff31cba61d8b,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f8981e-82') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41f8981e-82, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:16:08 user nova-compute[71312]: INFO os_vif [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:64:08,bridge_name='br-int',has_traffic_filtering=True,id=41f8981e-82cc-48ba-b87f-ff31cba61d8b,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f8981e-82')
Jul 25 10:16:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCpnJYaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:16:08 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c988e4-af3d-402b-a927-569830011ab9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:16:08 user nova-compute[71312]: No targets found.
Jul 25 10:16:08 user nova-compute[71312]: iSNS:
Jul 25 10:16:08 user nova-compute[71312]: No targets found.
Jul 25 10:16:08 user nova-compute[71312]: STATIC:
Jul 25 10:16:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:16:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:16:08 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:16:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24
Jul 25 10:16:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:16:08 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:16:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577
Jul 25 10:16:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:16:08 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:16:08 user nova-compute[71312]: FIRMWARE:
Jul 25 10:16:08 user nova-compute[71312]: No targets found.
Jul 25 10:16:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:16:08 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:16:08 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c171c5-cca7-4269-8387-f742b477a3f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc234e1a-0171-47c6-9439-83724bc1c343]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:16:08 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:16:08 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:16:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:16:08 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:16:08 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 (non-flash)
Jul 25 10:16:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a87f1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577'): ({'sde'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Removing single pathed devices sde {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f2e278-f632-4a93-b075-bbab54440ac1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34e0d56-6ed7-4fb1-a4aa-dceede489581]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Flushing IO for device /dev/sde {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9ff298-a44c-4bb6-8638-a3f6c963f035]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37ebcd0-1ac9-42c4-a893-dd4219c73ac4]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb5601f80-6dc5dfcb78cc1ec2', '/dev/disk/by-id/scsi-23664633564666362', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b5601f80') {{(pid=82549) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 10:16:08 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOb5601f80-6dc5dfcb78cc1ec2
Jul 25 10:16:08 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23664633564666362
Jul 25 10:16:08 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_b5601f80
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d160aca6-ca26-444e-b80c-4e9e886c8897]: (4, None) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[747d4307-d14a-4cef-98ca-a6120bf3709b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb69c828-7205-49e5-8ec5-422414fa5ed1]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260]
Jul 25 10:16:08 user nova-compute[71312]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577, portal: 172.16.0.220,3260] successful.
Jul 25 10:16:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:16:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:021e3404-c8a0-49c4-b976-7e9368b60577 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[928621c3-d019-4104-b64c-0bb595061c3f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:16:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:16:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:16:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] <== disconnect_volume: return (415ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:16:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:16:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Deleting instance files /opt/stack/data/nova/instances/e76c87fb-557c-4451-95c0-a55936db7e23_del
Jul 25 10:16:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Deletion of /opt/stack/data/nova/instances/e76c87fb-557c-4451-95c0-a55936db7e23_del complete
Jul 25 10:16:09 user nova-compute[71312]: INFO nova.compute.manager [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Took 1.38 seconds to destroy the instance on the hypervisor.
Jul 25 10:16:09 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:16:09 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:16:09 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:16:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:09 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:16:09 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Took 0.83 seconds to deallocate network for instance.
Jul 25 10:16:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-18ac90ba-41c6-444c-9045-0e7d297f2d9e req-2e7a70f4-334f-47ae-9bc1-5e3be505f0ef service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-deleted-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] No waiting events found dispatching network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:16:10 user nova-compute[71312]: WARNING nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received unexpected event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b for instance with vm_state active and task_state deleting.
Jul 25 10:16:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] No waiting events found dispatching network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:16:10 user nova-compute[71312]: WARNING nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received unexpected event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b for instance with vm_state active and task_state deleting.
Jul 25 10:16:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] No waiting events found dispatching network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:16:10 user nova-compute[71312]: WARNING nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received unexpected event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b for instance with vm_state active and task_state deleting.
Jul 25 10:16:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-unplugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] No waiting events found dispatching network-vif-unplugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-unplugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Acquiring lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] Lock "e76c87fb-557c-4451-95c0-a55936db7e23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] No waiting events found dispatching network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:16:10 user nova-compute[71312]: WARNING nova.compute.manager [req-abcc1732-25af-470f-ad1f-1aef02816bff req-50c8e521-3355-4f5e-8684-20bb5063e37c service nova] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Received unexpected event network-vif-plugged-41f8981e-82cc-48ba-b87f-ff31cba61d8b for instance with vm_state active and task_state deleting.
Jul 25 10:16:10 user nova-compute[71312]: INFO nova.compute.manager [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Took 0.80 seconds to detach 1 volumes for instance.
Jul 25 10:16:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Deleting volume: 021e3404-c8a0-49c4-b976-7e9368b60577 {{(pid=71312) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:11 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:16:11 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:16:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:11 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Deleted allocations for instance e76c87fb-557c-4451-95c0-a55936db7e23
Jul 25 10:16:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3f82527-e08f-4c28-ae97-a81f4a5794e5 tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "e76c87fb-557c-4451-95c0-a55936db7e23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.671s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:18 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280163.4987953, cba49a3e-0ffe-4ea2-a956-bb41c178dd38 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:16:18 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] VM Stopped (Lifecycle Event)
Jul 25 10:16:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ac845f46-5a12-45e4-8561-a4ff222af291 None None] [instance: cba49a3e-0ffe-4ea2-a956-bb41c178dd38] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:16:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:23 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280168.5344212, e76c87fb-557c-4451-95c0-a55936db7e23 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:16:23 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] VM Stopped (Lifecycle Event)
Jul 25 10:16:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8705fa71-947b-456a-b74b-420f90f2430c None None] [instance: e76c87fb-557c-4451-95c0-a55936db7e23] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:16:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:16:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:16:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:16:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:16:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:16:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:16:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:16:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Updating instance_info_cache with network_info: [{"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:16:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-8216c52e-c0a7-42b1-9766-7bcffa376b28" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:16:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:16:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:16:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:16:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:16:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "93222ef6-cba1-4427-a573-5c60c718db6c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "93222ef6-cba1-4427-a573-5c60c718db6c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:28 user nova-compute[71312]: INFO nova.compute.manager [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Unshelving
Jul 25 10:16:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'pci_requests' on Instance uuid 93222ef6-cba1-4427-a573-5c60c718db6c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:16:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'numa_topology' on Instance uuid 93222ef6-cba1-4427-a573-5c60c718db6c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:16:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:16:29 user nova-compute[71312]: INFO nova.compute.claims [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Claim successful on node user
Jul 25 10:16:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Refreshing inventories for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 10:16:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Updating ProviderTree inventory for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 10:16:29 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Updating inventory in ProviderTree for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 10:16:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Refreshing aggregate associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 10:16:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Refreshing trait associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, traits: COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 10:16:29 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:16:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:16:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:29 user nova-compute[71312]: INFO nova.network.neutron [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Updating port a8db9b27-beab-4c26-a2d9-cc428589bf62 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 25 10:16:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:16:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:16:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:16:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:16:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquired lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:16:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:16:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-85400ccc-e630-4d59-918f-69433bd7049a req-8d5e7adb-94a2-4390-80c9-e01254c821b8 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received event network-changed-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-85400ccc-e630-4d59-918f-69433bd7049a req-8d5e7adb-94a2-4390-80c9-e01254c821b8 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Refreshing instance network info cache due to event network-changed-a8db9b27-beab-4c26-a2d9-cc428589bf62. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:16:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85400ccc-e630-4d59-918f-69433bd7049a req-8d5e7adb-94a2-4390-80c9-e01254c821b8 service nova] Acquiring lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:16:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Updating instance_info_cache with network_info: [{"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Releasing lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:16:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:16:32 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Creating image(s)
Jul 25 10:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "/opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "/opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "/opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'trusted_certs' on Instance uuid 93222ef6-cba1-4427-a573-5c60c718db6c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85400ccc-e630-4d59-918f-69433bd7049a req-8d5e7adb-94a2-4390-80c9-e01254c821b8 service nova] Acquired lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:16:32 user nova-compute[71312]: DEBUG nova.network.neutron [req-85400ccc-e630-4d59-918f-69433bd7049a req-8d5e7adb-94a2-4390-80c9-e01254c821b8 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Refreshing network info cache for port a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "72e6d375d93848b5720902266edd99508a303279" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "72e6d375d93848b5720902266edd99508a303279" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:16:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279.part --force-share --output=json" returned: 0 in 0.161s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:33 user nova-compute[71312]: DEBUG nova.virt.images [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] 426cf81a-c39a-4419-8fe8-a951889a0c61 was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 10:16:33 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279.part /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG nova.network.neutron [req-85400ccc-e630-4d59-918f-69433bd7049a req-8d5e7adb-94a2-4390-80c9-e01254c821b8 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Updated VIF entry in instance network info cache for port a8db9b27-beab-4c26-a2d9-cc428589bf62. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG nova.network.neutron [req-85400ccc-e630-4d59-918f-69433bd7049a req-8d5e7adb-94a2-4390-80c9-e01254c821b8 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Updating instance_info_cache with network_info: [{"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85400ccc-e630-4d59-918f-69433bd7049a req-8d5e7adb-94a2-4390-80c9-e01254c821b8 service nova] Releasing lock "refresh_cache-93222ef6-cba1-4427-a573-5c60c718db6c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279.part /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279.converted" returned: 0 in 0.997s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279.converted --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "72e6d375d93848b5720902266edd99508a303279" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.745s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279 --force-share --output=json" returned: 0 in 0.149s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "72e6d375d93848b5720902266edd99508a303279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "72e6d375d93848b5720902266edd99508a303279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279 --force-share --output=json" returned: 0 in 0.163s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279,backing_fmt=raw /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279,backing_fmt=raw /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk 1073741824" returned: 0 in 0.057s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "72e6d375d93848b5720902266edd99508a303279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279 --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'migration_context' on Instance uuid 93222ef6-cba1-4427-a573-5c60c718db6c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:16:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Rebasing disk image.
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 -F raw /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:36 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:16:36 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:16:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7684MB free_disk=24.98965835571289GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:16:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:16:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance bcc93774-32b0-4592-bf6a-d655bac21d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:16:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:16:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 2e01c123-09c0-4a29-abf0-727f61484747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:16:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 80e8cdf1-c86a-43aa-a66c-46af281187a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:16:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f5aa6ae1-551a-4f51-a29f-14612f9b17e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:16:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b8e398f8-9e73-4077-a773-fdd1e494d37f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:16:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 51dc74c6-c677-4e31-b537-8d9507118520 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:16:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (c43d9a23-2919-4969-9b66-f1d29eb9e809): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jul 25 10:16:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:16:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:16:37 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:16:37 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.233s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 -F raw /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk" returned: 0 in 2.998s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Ensure instance console log exists: /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Start _get_guest_xml network_info=[{"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a38f824a676f5319c4c7307241c9e604',container_format='bare',created_at=2023-07-25T10:14:35Z,direct_url=<?>,disk_format='qcow2',id=426cf81a-c39a-4419-8fe8-a951889a0c61,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-228881500-shelved',owner='23211f867d6049f5bb1901e03e8dc396',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-25T10:14:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:16:38 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:16:38 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a38f824a676f5319c4c7307241c9e604',container_format='bare',created_at=2023-07-25T10:14:35Z,direct_url=<?>,disk_format='qcow2',id=426cf81a-c39a-4419-8fe8-a951889a0c61,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-228881500-shelved',owner='23211f867d6049f5bb1901e03e8dc396',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-25T10:14:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.objects.instance [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'vcpu_model' on Instance uuid 93222ef6-cba1-4427-a573-5c60c718db6c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-228881500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-228881500',id=31,image_ref='426cf81a-c39a-4419-8fe8-a951889a0c61',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1429184951',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:12:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='23211f867d6049f5bb1901e03e8dc396',ramdisk_id='',reservation_id='r-zkfj7ysk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1954806993',owner_user_name='tempest-AttachVolumeShelveTestJSON-1954806993-project-member',shelved_at='2023-07-25T10:14:38.891492',shelved_host='user',shelved_image_id='426cf81a-c39a-4419-8fe8-a951889a0c61'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec3ee9c206b43448eb6479cad0b437c',uuid=93222ef6-cba1-4427-a573-5c60c718db6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converting VIF {"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:80:27,bridge_name='br-int',has_traffic_filtering=True,id=a8db9b27-beab-4c26-a2d9-cc428589bf62,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db9b27-be') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.objects.instance [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'pci_devices' on Instance uuid 93222ef6-cba1-4427-a573-5c60c718db6c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:16:38 user nova-compute[71312]:   <uuid>93222ef6-cba1-4427-a573-5c60c718db6c</uuid>
Jul 25 10:16:38 user nova-compute[71312]:   <name>instance-0000001f</name>
Jul 25 10:16:38 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:16:38 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:16:38 user nova-compute[71312]:   <metadata>
Jul 25 10:16:38 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:16:38 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:16:38 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-228881500</nova:name>
Jul 25 10:16:38 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:16:38</nova:creationTime>
Jul 25 10:16:38 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:16:38 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:16:38 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:16:38 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:16:38 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:16:38 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:16:38 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:16:38 user nova-compute[71312]:       <nova:owner>
Jul 25 10:16:38 user nova-compute[71312]:         <nova:user uuid="0ec3ee9c206b43448eb6479cad0b437c">tempest-AttachVolumeShelveTestJSON-1954806993-project-member</nova:user>
Jul 25 10:16:38 user nova-compute[71312]:         <nova:project uuid="23211f867d6049f5bb1901e03e8dc396">tempest-AttachVolumeShelveTestJSON-1954806993</nova:project>
Jul 25 10:16:38 user nova-compute[71312]:       </nova:owner>
Jul 25 10:16:38 user nova-compute[71312]:       <nova:root type="image" uuid="426cf81a-c39a-4419-8fe8-a951889a0c61"/>
Jul 25 10:16:38 user nova-compute[71312]:       <nova:ports>
Jul 25 10:16:38 user nova-compute[71312]:         <nova:port uuid="a8db9b27-beab-4c26-a2d9-cc428589bf62">
Jul 25 10:16:38 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 10:16:38 user nova-compute[71312]:         </nova:port>
Jul 25 10:16:38 user nova-compute[71312]:       </nova:ports>
Jul 25 10:16:38 user nova-compute[71312]:     </nova:instance>
Jul 25 10:16:38 user nova-compute[71312]:   </metadata>
Jul 25 10:16:38 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:16:38 user nova-compute[71312]:     <system>
Jul 25 10:16:38 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:16:38 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:16:38 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:16:38 user nova-compute[71312]:       <entry name="serial">93222ef6-cba1-4427-a573-5c60c718db6c</entry>
Jul 25 10:16:38 user nova-compute[71312]:       <entry name="uuid">93222ef6-cba1-4427-a573-5c60c718db6c</entry>
Jul 25 10:16:38 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:16:38 user nova-compute[71312]:     </system>
Jul 25 10:16:38 user nova-compute[71312]:   </sysinfo>
Jul 25 10:16:38 user nova-compute[71312]:   <os>
Jul 25 10:16:38 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:16:38 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:16:38 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:16:38 user nova-compute[71312]:   </os>
Jul 25 10:16:38 user nova-compute[71312]:   <features>
Jul 25 10:16:38 user nova-compute[71312]:     <acpi/>
Jul 25 10:16:38 user nova-compute[71312]:     <apic/>
Jul 25 10:16:38 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:16:38 user nova-compute[71312]:   </features>
Jul 25 10:16:38 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:16:38 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:16:38 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:16:38 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:16:38 user nova-compute[71312]:   </clock>
Jul 25 10:16:38 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:16:38 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:16:38 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:16:38 user nova-compute[71312]:   </cpu>
Jul 25 10:16:38 user nova-compute[71312]:   <devices>
Jul 25 10:16:38 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:16:38 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:16:38 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk"/>
Jul 25 10:16:38 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:16:38 user nova-compute[71312]:     </disk>
Jul 25 10:16:38 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:16:38 user nova-compute[71312]:       <mac address="fa:16:3e:16:80:27"/>
Jul 25 10:16:38 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:16:38 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:16:38 user nova-compute[71312]:       <target dev="tapa8db9b27-be"/>
Jul 25 10:16:38 user nova-compute[71312]:     </interface>
Jul 25 10:16:38 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:16:38 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/console.log" append="off"/>
Jul 25 10:16:38 user nova-compute[71312]:     </serial>
Jul 25 10:16:38 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:16:38 user nova-compute[71312]:     <video>
Jul 25 10:16:38 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:16:38 user nova-compute[71312]:     </video>
Jul 25 10:16:38 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:16:38 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:16:38 user nova-compute[71312]:     </rng>
Jul 25 10:16:38 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:16:38 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:16:38 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:16:38 user nova-compute[71312]:     </memballoon>
Jul 25 10:16:38 user nova-compute[71312]:   </devices>
Jul 25 10:16:38 user nova-compute[71312]: </domain>
Jul 25 10:16:38 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-228881500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-228881500',id=31,image_ref='426cf81a-c39a-4419-8fe8-a951889a0c61',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1429184951',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:12:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='23211f867d6049f5bb1901e03e8dc396',ramdisk_id='',reservation_id='r-zkfj7ysk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1954806993',owner_user_name='tempest-AttachVolumeShelveTestJSON-1954806993-project-member',shelved_at='2023-07-25T10:14:38.891492',shelved_host='user',shelved_image_id='426cf81a-c39a-4419-8fe8-a951889a0c61'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec3ee9c206b43448eb6479cad0b437c',uuid=93222ef6-cba1-4427-a573-5c60c718db6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converting VIF {"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:80:27,bridge_name='br-int',has_traffic_filtering=True,id=a8db9b27-beab-4c26-a2d9-cc428589bf62,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db9b27-be') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG os_vif [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:80:27,bridge_name='br-int',has_traffic_filtering=True,id=a8db9b27-beab-4c26-a2d9-cc428589bf62,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db9b27-be') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8db9b27-be, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa8db9b27-be, col_values=(('external_ids', {'iface-id': 'a8db9b27-beab-4c26-a2d9-cc428589bf62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:80:27', 'vm-uuid': '93222ef6-cba1-4427-a573-5c60c718db6c'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:38 user nova-compute[71312]: INFO os_vif [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:80:27,bridge_name='br-int',has_traffic_filtering=True,id=a8db9b27-beab-4c26-a2d9-cc428589bf62,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db9b27-be')
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:16:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] No VIF found with MAC fa:16:3e:16:80:27, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:16:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:16:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-6d053bd5-c6d2-49f6-bc03-582915d14c9b req-1f35602f-8fa5-409e-ac7a-0145f3aa7b5d service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received event network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6d053bd5-c6d2-49f6-bc03-582915d14c9b req-1f35602f-8fa5-409e-ac7a-0145f3aa7b5d service nova] Acquiring lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6d053bd5-c6d2-49f6-bc03-582915d14c9b req-1f35602f-8fa5-409e-ac7a-0145f3aa7b5d service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6d053bd5-c6d2-49f6-bc03-582915d14c9b req-1f35602f-8fa5-409e-ac7a-0145f3aa7b5d service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-6d053bd5-c6d2-49f6-bc03-582915d14c9b req-1f35602f-8fa5-409e-ac7a-0145f3aa7b5d service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] No waiting events found dispatching network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:16:40 user nova-compute[71312]: WARNING nova.compute.manager [req-6d053bd5-c6d2-49f6-bc03-582915d14c9b req-1f35602f-8fa5-409e-ac7a-0145f3aa7b5d service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received unexpected event network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 10:16:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-677aa4dd-41aa-4886-b5d7-11a1cdd2cdc1 req-e8ad3593-ef3c-4dec-a972-a9bdfb4bf3ca service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received event network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-677aa4dd-41aa-4886-b5d7-11a1cdd2cdc1 req-e8ad3593-ef3c-4dec-a972-a9bdfb4bf3ca service nova] Acquiring lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-677aa4dd-41aa-4886-b5d7-11a1cdd2cdc1 req-e8ad3593-ef3c-4dec-a972-a9bdfb4bf3ca service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-677aa4dd-41aa-4886-b5d7-11a1cdd2cdc1 req-e8ad3593-ef3c-4dec-a972-a9bdfb4bf3ca service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-677aa4dd-41aa-4886-b5d7-11a1cdd2cdc1 req-e8ad3593-ef3c-4dec-a972-a9bdfb4bf3ca service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] No waiting events found dispatching network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:16:42 user nova-compute[71312]: WARNING nova.compute.manager [req-677aa4dd-41aa-4886-b5d7-11a1cdd2cdc1 req-e8ad3593-ef3c-4dec-a972-a9bdfb4bf3ca service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received unexpected event network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 10:16:42 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280202.7098713, 93222ef6-cba1-4427-a573-5c60c718db6c => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:16:42 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] VM Resumed (Lifecycle Event)
Jul 25 10:16:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:16:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:16:42 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Instance spawned successfully.
Jul 25 10:16:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:16:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:16:42 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:16:42 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280202.7107258, 93222ef6-cba1-4427-a573-5c60c718db6c => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:16:42 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] VM Started (Lifecycle Event)
Jul 25 10:16:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:16:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:16:42 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:16:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:16:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-32d025ec-769e-44cd-a4a7-7cf6884568a7 tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "93222ef6-cba1-4427-a573-5c60c718db6c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.135s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:16:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:16:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:16:54 user nova-compute[71312]: INFO nova.compute.claims [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Claim successful on node user
Jul 25 10:16:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG nova.network.neutron [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:16:55 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:16:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG nova.policy [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '558acd016f0d40d6ad4eee118bfa9e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b26f355fd1645049dae1f37866d4710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:16:55 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Creating image(s)
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "/opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "/opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.149s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.176s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk 1073741824" returned: 0 in 0.057s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:16:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG nova.network.neutron [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Successfully created port: 27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Cannot resize image /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG nova.objects.instance [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lazy-loading 'migration_context' on Instance uuid 7a96ad84-e354-49bf-8234-0edcfa435ae9 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Ensure instance console log exists: /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG nova.network.neutron [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Successfully updated port: 27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "refresh_cache-7a96ad84-e354-49bf-8234-0edcfa435ae9" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquired lock "refresh_cache-7a96ad84-e354-49bf-8234-0edcfa435ae9" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG nova.network.neutron [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-5f1b5570-0dd0-470e-98a6-0755e56c3791 req-b10f386d-ec3c-487b-b0ad-040dab39fe26 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Received event network-changed-27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-5f1b5570-0dd0-470e-98a6-0755e56c3791 req-b10f386d-ec3c-487b-b0ad-040dab39fe26 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Refreshing instance network info cache due to event network-changed-27d9fdcf-28a9-4c75-9369-d21fcf4313fd. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5f1b5570-0dd0-470e-98a6-0755e56c3791 req-b10f386d-ec3c-487b-b0ad-040dab39fe26 service nova] Acquiring lock "refresh_cache-7a96ad84-e354-49bf-8234-0edcfa435ae9" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:16:56 user nova-compute[71312]: DEBUG nova.network.neutron [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_power_states {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:16:57 user nova-compute[71312]: WARNING nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 5823c859-058e-4b2f-91b0-0e4def11bebf {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 8216c52e-c0a7-42b1-9766-7bcffa376b28 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 2e01c123-09c0-4a29-abf0-727f61484747 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 80e8cdf1-c86a-43aa-a66c-46af281187a5 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid f5aa6ae1-551a-4f51-a29f-14612f9b17e6 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid b8e398f8-9e73-4077-a773-fdd1e494d37f {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 93222ef6-cba1-4427-a573-5c60c718db6c {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 51dc74c6-c677-4e31-b537-8d9507118520 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 7a96ad84-e354-49bf-8234-0edcfa435ae9 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "5823c859-058e-4b2f-91b0-0e4def11bebf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "2e01c123-09c0-4a29-abf0-727f61484747" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "2e01c123-09c0-4a29-abf0-727f61484747" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "80e8cdf1-c86a-43aa-a66c-46af281187a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "93222ef6-cba1-4427-a573-5c60c718db6c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "93222ef6-cba1-4427-a573-5c60c718db6c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "51dc74c6-c677-4e31-b537-8d9507118520" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "51dc74c6-c677-4e31-b537-8d9507118520" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Updating instance_info_cache with network_info: [{"id": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "address": "fa:16:3e:95:f9:97", "network": {"id": "37efbc22-d431-443d-84e3-a6438b837541", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-753576595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b26f355fd1645049dae1f37866d4710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d9fdcf-28", "ovs_interfaceid": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Releasing lock "refresh_cache-7a96ad84-e354-49bf-8234-0edcfa435ae9" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Instance network_info: |[{"id": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "address": "fa:16:3e:95:f9:97", "network": {"id": "37efbc22-d431-443d-84e3-a6438b837541", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-753576595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b26f355fd1645049dae1f37866d4710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d9fdcf-28", "ovs_interfaceid": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5f1b5570-0dd0-470e-98a6-0755e56c3791 req-b10f386d-ec3c-487b-b0ad-040dab39fe26 service nova] Acquired lock "refresh_cache-7a96ad84-e354-49bf-8234-0edcfa435ae9" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.network.neutron [req-5f1b5570-0dd0-470e-98a6-0755e56c3791 req-b10f386d-ec3c-487b-b0ad-040dab39fe26 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Refreshing network info cache for port 27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Start _get_guest_xml network_info=[{"id": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "address": "fa:16:3e:95:f9:97", "network": {"id": "37efbc22-d431-443d-84e3-a6438b837541", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-753576595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b26f355fd1645049dae1f37866d4710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d9fdcf-28", "ovs_interfaceid": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "2e01c123-09c0-4a29-abf0-727f61484747" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:57 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:16:57 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "93222ef6-cba1-4427-a573-5c60c718db6c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-333914761',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-333914761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3339147',id=34,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLdXCPc5AgdLIosQdycWIDsGcra0cfWGZHLmOHNwKt4pl09MnWFc9R4H1sjcyvvF99X0OFlAITUeBzJSaIuob4l1rAmuiRVLbyOi+QGF1IOgmHmU64Gxcd8i1R5r1k4Sg==',key_name='tempest-keypair-1564691037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b26f355fd1645049dae1f37866d4710',ramdisk_id='',reservation_id='r-b0xh28qt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-503790817',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:16:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='558acd016f0d40d6ad4eee118bfa9e42',uuid=7a96ad84-e354-49bf-8234-0edcfa435ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "address": "fa:16:3e:95:f9:97", "network": {"id": "37efbc22-d431-443d-84e3-a6438b837541", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-753576595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b26f355fd1645049dae1f37866d4710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d9fdcf-28", "ovs_interfaceid": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Converting VIF {"id": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "address": "fa:16:3e:95:f9:97", "network": {"id": "37efbc22-d431-443d-84e3-a6438b837541", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-753576595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b26f355fd1645049dae1f37866d4710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d9fdcf-28", "ovs_interfaceid": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=27d9fdcf-28a9-4c75-9369-d21fcf4313fd,network=Network(37efbc22-d431-443d-84e3-a6438b837541),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d9fdcf-28') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.objects.instance [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a96ad84-e354-49bf-8234-0edcfa435ae9 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "51dc74c6-c677-4e31-b537-8d9507118520" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.164s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:16:57 user nova-compute[71312]:   <uuid>7a96ad84-e354-49bf-8234-0edcfa435ae9</uuid>
Jul 25 10:16:57 user nova-compute[71312]:   <name>instance-00000022</name>
Jul 25 10:16:57 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:16:57 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:16:57 user nova-compute[71312]:   <metadata>
Jul 25 10:16:57 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:16:57 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:16:57 user nova-compute[71312]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-333914761</nova:name>
Jul 25 10:16:57 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:16:57</nova:creationTime>
Jul 25 10:16:57 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:16:57 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:16:57 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:16:57 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:16:57 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:16:57 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:16:57 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:16:57 user nova-compute[71312]:       <nova:owner>
Jul 25 10:16:57 user nova-compute[71312]:         <nova:user uuid="558acd016f0d40d6ad4eee118bfa9e42">tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member</nova:user>
Jul 25 10:16:57 user nova-compute[71312]:         <nova:project uuid="6b26f355fd1645049dae1f37866d4710">tempest-TestServerVolumeAttachScenarioOldVersion-503790817</nova:project>
Jul 25 10:16:57 user nova-compute[71312]:       </nova:owner>
Jul 25 10:16:57 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:16:57 user nova-compute[71312]:       <nova:ports>
Jul 25 10:16:57 user nova-compute[71312]:         <nova:port uuid="27d9fdcf-28a9-4c75-9369-d21fcf4313fd">
Jul 25 10:16:57 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 10:16:57 user nova-compute[71312]:         </nova:port>
Jul 25 10:16:57 user nova-compute[71312]:       </nova:ports>
Jul 25 10:16:57 user nova-compute[71312]:     </nova:instance>
Jul 25 10:16:57 user nova-compute[71312]:   </metadata>
Jul 25 10:16:57 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:16:57 user nova-compute[71312]:     <system>
Jul 25 10:16:57 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:16:57 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:16:57 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:16:57 user nova-compute[71312]:       <entry name="serial">7a96ad84-e354-49bf-8234-0edcfa435ae9</entry>
Jul 25 10:16:57 user nova-compute[71312]:       <entry name="uuid">7a96ad84-e354-49bf-8234-0edcfa435ae9</entry>
Jul 25 10:16:57 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:16:57 user nova-compute[71312]:     </system>
Jul 25 10:16:57 user nova-compute[71312]:   </sysinfo>
Jul 25 10:16:57 user nova-compute[71312]:   <os>
Jul 25 10:16:57 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:16:57 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:16:57 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:16:57 user nova-compute[71312]:   </os>
Jul 25 10:16:57 user nova-compute[71312]:   <features>
Jul 25 10:16:57 user nova-compute[71312]:     <acpi/>
Jul 25 10:16:57 user nova-compute[71312]:     <apic/>
Jul 25 10:16:57 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:16:57 user nova-compute[71312]:   </features>
Jul 25 10:16:57 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:16:57 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:16:57 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:16:57 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:16:57 user nova-compute[71312]:   </clock>
Jul 25 10:16:57 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:16:57 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:16:57 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:16:57 user nova-compute[71312]:   </cpu>
Jul 25 10:16:57 user nova-compute[71312]:   <devices>
Jul 25 10:16:57 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:16:57 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:16:57 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk"/>
Jul 25 10:16:57 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:16:57 user nova-compute[71312]:     </disk>
Jul 25 10:16:57 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:16:57 user nova-compute[71312]:       <mac address="fa:16:3e:95:f9:97"/>
Jul 25 10:16:57 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:16:57 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:16:57 user nova-compute[71312]:       <target dev="tap27d9fdcf-28"/>
Jul 25 10:16:57 user nova-compute[71312]:     </interface>
Jul 25 10:16:57 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:16:57 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/console.log" append="off"/>
Jul 25 10:16:57 user nova-compute[71312]:     </serial>
Jul 25 10:16:57 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:16:57 user nova-compute[71312]:     <video>
Jul 25 10:16:57 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:16:57 user nova-compute[71312]:     </video>
Jul 25 10:16:57 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:16:57 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:16:57 user nova-compute[71312]:     </rng>
Jul 25 10:16:57 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:16:57 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:16:57 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:16:57 user nova-compute[71312]:     </memballoon>
Jul 25 10:16:57 user nova-compute[71312]:   </devices>
Jul 25 10:16:57 user nova-compute[71312]: </domain>
Jul 25 10:16:57 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-333914761',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-333914761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3339147',id=34,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLdXCPc5AgdLIosQdycWIDsGcra0cfWGZHLmOHNwKt4pl09MnWFc9R4H1sjcyvvF99X0OFlAITUeBzJSaIuob4l1rAmuiRVLbyOi+QGF1IOgmHmU64Gxcd8i1R5r1k4Sg==',key_name='tempest-keypair-1564691037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b26f355fd1645049dae1f37866d4710',ramdisk_id='',reservation_id='r-b0xh28qt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-503790817',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:16:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='558acd016f0d40d6ad4eee118bfa9e42',uuid=7a96ad84-e354-49bf-8234-0edcfa435ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "address": "fa:16:3e:95:f9:97", "network": {"id": "37efbc22-d431-443d-84e3-a6438b837541", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-753576595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b26f355fd1645049dae1f37866d4710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d9fdcf-28", "ovs_interfaceid": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Converting VIF {"id": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "address": "fa:16:3e:95:f9:97", "network": {"id": "37efbc22-d431-443d-84e3-a6438b837541", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-753576595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b26f355fd1645049dae1f37866d4710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d9fdcf-28", "ovs_interfaceid": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=27d9fdcf-28a9-4c75-9369-d21fcf4313fd,network=Network(37efbc22-d431-443d-84e3-a6438b837541),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d9fdcf-28') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG os_vif [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=27d9fdcf-28a9-4c75-9369-d21fcf4313fd,network=Network(37efbc22-d431-443d-84e3-a6438b837541),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d9fdcf-28') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27d9fdcf-28, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27d9fdcf-28, col_values=(('external_ids', {'iface-id': '27d9fdcf-28a9-4c75-9369-d21fcf4313fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:f9:97', 'vm-uuid': '7a96ad84-e354-49bf-8234-0edcfa435ae9'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:57 user nova-compute[71312]: INFO os_vif [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=27d9fdcf-28a9-4c75-9369-d21fcf4313fd,network=Network(37efbc22-d431-443d-84e3-a6438b837541),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d9fdcf-28')
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] No VIF found with MAC fa:16:3e:95:f9:97, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.network.neutron [req-5f1b5570-0dd0-470e-98a6-0755e56c3791 req-b10f386d-ec3c-487b-b0ad-040dab39fe26 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Updated VIF entry in instance network info cache for port 27d9fdcf-28a9-4c75-9369-d21fcf4313fd. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG nova.network.neutron [req-5f1b5570-0dd0-470e-98a6-0755e56c3791 req-b10f386d-ec3c-487b-b0ad-040dab39fe26 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Updating instance_info_cache with network_info: [{"id": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "address": "fa:16:3e:95:f9:97", "network": {"id": "37efbc22-d431-443d-84e3-a6438b837541", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-753576595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b26f355fd1645049dae1f37866d4710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d9fdcf-28", "ovs_interfaceid": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:16:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5f1b5570-0dd0-470e-98a6-0755e56c3791 req-b10f386d-ec3c-487b-b0ad-040dab39fe26 service nova] Releasing lock "refresh_cache-7a96ad84-e354-49bf-8234-0edcfa435ae9" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:16:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-4751c132-927a-4713-bfb0-eb9ae3d7aa7c req-ff505c0b-a630-43a5-9c4c-88e1f3c7a764 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Received event network-vif-plugged-27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4751c132-927a-4713-bfb0-eb9ae3d7aa7c req-ff505c0b-a630-43a5-9c4c-88e1f3c7a764 service nova] Acquiring lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4751c132-927a-4713-bfb0-eb9ae3d7aa7c req-ff505c0b-a630-43a5-9c4c-88e1f3c7a764 service nova] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4751c132-927a-4713-bfb0-eb9ae3d7aa7c req-ff505c0b-a630-43a5-9c4c-88e1f3c7a764 service nova] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-4751c132-927a-4713-bfb0-eb9ae3d7aa7c req-ff505c0b-a630-43a5-9c4c-88e1f3c7a764 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] No waiting events found dispatching network-vif-plugged-27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:16:59 user nova-compute[71312]: WARNING nova.compute.manager [req-4751c132-927a-4713-bfb0-eb9ae3d7aa7c req-ff505c0b-a630-43a5-9c4c-88e1f3c7a764 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Received unexpected event network-vif-plugged-27d9fdcf-28a9-4c75-9369-d21fcf4313fd for instance with vm_state building and task_state spawning.
Jul 25 10:16:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "80e8cdf1-c86a-43aa-a66c-46af281187a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:59 user nova-compute[71312]: INFO nova.compute.manager [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Terminating instance
Jul 25 10:16:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:16:59 user nova-compute[71312]: INFO nova.compute.manager [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Terminating instance
Jul 25 10:16:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:16:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-5a393f6a-a35b-4b5f-ab52-ec3282e6a305 req-badc4eca-409f-4579-a3a9-238d973263f5 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-unplugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5a393f6a-a35b-4b5f-ab52-ec3282e6a305 req-badc4eca-409f-4579-a3a9-238d973263f5 service nova] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5a393f6a-a35b-4b5f-ab52-ec3282e6a305 req-badc4eca-409f-4579-a3a9-238d973263f5 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5a393f6a-a35b-4b5f-ab52-ec3282e6a305 req-badc4eca-409f-4579-a3a9-238d973263f5 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-5a393f6a-a35b-4b5f-ab52-ec3282e6a305 req-badc4eca-409f-4579-a3a9-238d973263f5 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] No waiting events found dispatching network-vif-unplugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-5a393f6a-a35b-4b5f-ab52-ec3282e6a305 req-badc4eca-409f-4579-a3a9-238d973263f5 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-unplugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Instance destroyed successfully.
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lazy-loading 'resources' on Instance uuid 80e8cdf1-c86a-43aa-a66c-46af281187a5 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Instance destroyed successfully.
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lazy-loading 'resources' on Instance uuid bcc93774-32b0-4592-bf6a-d655bac21d39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-106862461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-106862461',id=23,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdQM82Qejh+nCjNUoCEwa+DKMm0p2VFnjpf/T0PHj6mKTHaG9P7+dSiT5CBJYIEOhDFNdBvLGEX+Bgxld753JvW1e2toucYORGNEtErTZHvvfOcNDV6OOHiFOV59zZ0tA==',key_name='tempest-keypair-593905888',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:10:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8aa44925fd09496683b46b15f728e9ca',ramdisk_id='',reservation_id='r-nteiea17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1599012039',owner_user_name='tempest-ServerActionsV293TestJSON-1599012039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:10:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9b48294a6374f439d94cb121c01dca9',uuid=80e8cdf1-c86a-43aa-a66c-46af281187a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "address": "fa:16:3e:5c:c5:1c", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff58b4d-cb", "ovs_interfaceid": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converting VIF {"id": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "address": "fa:16:3e:5c:c5:1c", "network": {"id": "cfe17a7d-1796-410c-95a2-6647b92e938d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-339643400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa44925fd09496683b46b15f728e9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff58b4d-cb", "ovs_interfaceid": "8ff58b4d-cb02-4ba7-861d-086db41f3083", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:c5:1c,bridge_name='br-int',has_traffic_filtering=True,id=8ff58b4d-cb02-4ba7-861d-086db41f3083,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff58b4d-cb') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG os_vif [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:c5:1c,bridge_name='br-int',has_traffic_filtering=True,id=8ff58b4d-cb02-4ba7-861d-086db41f3083,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff58b4d-cb') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-164940161',display_name='tempest-ServerActionsTestOtherA-server-1344752152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-164940161',id=5,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7/PiN27E1zNONLGfU75gjTzl6TjLJTSPguo/w/NLGiNWvcFBQAXJk/RsZr2x3/TDzaN8UL9NG26qh75+qbwT35akc6FqjZaWZn3poJMiar+SGmPPXZDxAQP/CqYmNQIw==',key_name='tempest-keypair-2143034637',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:05:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c30d33a1a8945fdab6798c94a558444',ramdisk_id='',reservation_id='r-rxkl8cmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-408585031',owner_user_name='tempest-ServerActionsTestOtherA-408585031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfdced66e34e0ba7f9437e71aaee6a',uuid=bcc93774-32b0-4592-bf6a-d655bac21d39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converting VIF {"id": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "address": "fa:16:3e:e9:8e:2b", "network": {"id": "e752668b-0215-4c5a-be15-552a2592ea6f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-930793975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30d33a1a8945fdab6798c94a558444", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb436a-ed", "ovs_interfaceid": "d1cb436a-ed84-43ea-a32f-6c08effc60d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=d1cb436a-ed84-43ea-a32f-6c08effc60d6,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb436a-ed') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG os_vif [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=d1cb436a-ed84-43ea-a32f-6c08effc60d6,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb436a-ed') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ff58b4d-cb, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1cb436a-ed, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:17:00 user nova-compute[71312]: INFO os_vif [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:c5:1c,bridge_name='br-int',has_traffic_filtering=True,id=8ff58b4d-cb02-4ba7-861d-086db41f3083,network=Network(cfe17a7d-1796-410c-95a2-6647b92e938d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff58b4d-cb')
Jul 25 10:17:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Deleting instance files /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5_del
Jul 25 10:17:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Deletion of /opt/stack/data/nova/instances/80e8cdf1-c86a-43aa-a66c-46af281187a5_del complete
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:00 user nova-compute[71312]: INFO os_vif [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=d1cb436a-ed84-43ea-a32f-6c08effc60d6,network=Network(e752668b-0215-4c5a-be15-552a2592ea6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb436a-ed')
Jul 25 10:17:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Deleting instance files /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39_del
Jul 25 10:17:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Deletion of /opt/stack/data/nova/instances/bcc93774-32b0-4592-bf6a-d655bac21d39_del complete
Jul 25 10:17:00 user nova-compute[71312]: INFO nova.compute.manager [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Took 1.31 seconds to destroy the instance on the hypervisor.
Jul 25 10:17:00 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:17:00 user nova-compute[71312]: INFO nova.compute.manager [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Took 1.45 seconds to destroy the instance on the hypervisor.
Jul 25 10:17:00 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:17:00 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280221.5461693, 7a96ad84-e354-49bf-8234-0edcfa435ae9 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:17:01 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] VM Resumed (Lifecycle Event)
Jul 25 10:17:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:17:01 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Instance spawned successfully.
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:17:01 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280221.5464835, 7a96ad84-e354-49bf-8234-0edcfa435ae9 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:17:01 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] VM Started (Lifecycle Event)
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Received event network-vif-plugged-27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Acquiring lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] No waiting events found dispatching network-vif-plugged-27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:01 user nova-compute[71312]: WARNING nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Received unexpected event network-vif-plugged-27d9fdcf-28a9-4c75-9369-d21fcf4313fd for instance with vm_state building and task_state spawning.
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received event network-vif-unplugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Acquiring lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] No waiting events found dispatching network-vif-unplugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received event network-vif-unplugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received event network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Acquiring lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] No waiting events found dispatching network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:01 user nova-compute[71312]: WARNING nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received unexpected event network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 for instance with vm_state active and task_state deleting.
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received event network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Acquiring lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] No waiting events found dispatching network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:01 user nova-compute[71312]: WARNING nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received unexpected event network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 for instance with vm_state active and task_state deleting.
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received event network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Acquiring lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] No waiting events found dispatching network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:01 user nova-compute[71312]: WARNING nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received unexpected event network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 for instance with vm_state active and task_state deleting.
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received event network-vif-unplugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Acquiring lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] No waiting events found dispatching network-vif-unplugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received event network-vif-unplugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received event network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Acquiring lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] No waiting events found dispatching network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:01 user nova-compute[71312]: WARNING nova.compute.manager [req-b8bfeefd-3ae7-425e-93da-4affa505548c req-a9efb354-3bed-4ca2-957c-7a4722066e69 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received unexpected event network-vif-plugged-8ff58b4d-cb02-4ba7-861d-086db41f3083 for instance with vm_state active and task_state deleting.
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:17:01 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:17:01 user nova-compute[71312]: INFO nova.compute.manager [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Took 6.38 seconds to spawn the instance on the hypervisor.
Jul 25 10:17:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:17:01 user nova-compute[71312]: INFO nova.compute.manager [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Took 7.22 seconds to build instance.
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-df009885-a215-4b2c-86ed-113106ab6ad4 tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.360s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.705s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:01 user nova-compute[71312]: INFO nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:17:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] No waiting events found dispatching network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:02 user nova-compute[71312]: WARNING nova.compute.manager [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received unexpected event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 for instance with vm_state active and task_state deleting.
Jul 25 10:17:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] No waiting events found dispatching network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:02 user nova-compute[71312]: WARNING nova.compute.manager [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received unexpected event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 for instance with vm_state active and task_state deleting.
Jul 25 10:17:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] No waiting events found dispatching network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:02 user nova-compute[71312]: WARNING nova.compute.manager [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received unexpected event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 for instance with vm_state active and task_state deleting.
Jul 25 10:17:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-unplugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] No waiting events found dispatching network-vif-unplugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-5321d8c8-4a57-4bf1-9118-ee764e15e73d req-8095c01b-edfa-4158-a8f3-a5ce9b648723 service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-unplugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:17:02 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Took 1.47 seconds to deallocate network for instance.
Jul 25 10:17:02 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Took 1.48 seconds to deallocate network for instance.
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-cbb74221-fdec-4706-ad8f-f249107ce6b7 req-177cfb67-96ce-4e12-a452-c4fcc90f08a8 service nova] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Received event network-vif-deleted-8ff58b4d-cb02-4ba7-861d-086db41f3083 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.397s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:02 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Deleted allocations for instance bcc93774-32b0-4592-bf6a-d655bac21d39
Jul 25 10:17:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0337c678-c5a7-4450-8425-530f1b01e8b9 tempest-ServerActionsTestOtherA-408585031 tempest-ServerActionsTestOtherA-408585031-project-member] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.402s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:03 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:17:03 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:17:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:03 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Deleted allocations for instance 80e8cdf1-c86a-43aa-a66c-46af281187a5
Jul 25 10:17:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-48fbeca0-e331-42da-bb99-1a7fefcfa8df tempest-ServerActionsV293TestJSON-1599012039 tempest-ServerActionsV293TestJSON-1599012039-project-member] Lock "80e8cdf1-c86a-43aa-a66c-46af281187a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.958s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:17:04 user nova-compute[71312]: INFO nova.compute.claims [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Claim successful on node user
Jul 25 10:17:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-6f9378eb-345d-4edb-8b85-326b40792d0d req-46fd8e6c-1519-44f8-a617-bb5a70afb9fd service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f9378eb-345d-4edb-8b85-326b40792d0d req-46fd8e6c-1519-44f8-a617-bb5a70afb9fd service nova] Acquiring lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f9378eb-345d-4edb-8b85-326b40792d0d req-46fd8e6c-1519-44f8-a617-bb5a70afb9fd service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f9378eb-345d-4edb-8b85-326b40792d0d req-46fd8e6c-1519-44f8-a617-bb5a70afb9fd service nova] Lock "bcc93774-32b0-4592-bf6a-d655bac21d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-6f9378eb-345d-4edb-8b85-326b40792d0d req-46fd8e6c-1519-44f8-a617-bb5a70afb9fd service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] No waiting events found dispatching network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:04 user nova-compute[71312]: WARNING nova.compute.manager [req-6f9378eb-345d-4edb-8b85-326b40792d0d req-46fd8e6c-1519-44f8-a617-bb5a70afb9fd service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received unexpected event network-vif-plugged-d1cb436a-ed84-43ea-a32f-6c08effc60d6 for instance with vm_state deleted and task_state None.
Jul 25 10:17:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-6f9378eb-345d-4edb-8b85-326b40792d0d req-46fd8e6c-1519-44f8-a617-bb5a70afb9fd service nova] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Received event network-vif-deleted-d1cb436a-ed84-43ea-a32f-6c08effc60d6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:17:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:17:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG nova.policy [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6f0b54327ff42f389ff059e65014340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef43ca749d7c4576b084ddd6041c4c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:17:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Creating image(s)
Jul 25 10:17:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "/opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "/opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "/opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.174s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk 1073741824" returned: 0 in 0.056s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Checking if we can resize image /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Successfully created port: b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Cannot resize image /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lazy-loading 'migration_context' on Instance uuid 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Ensure instance console log exists: /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Successfully updated port: b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "refresh_cache-126801e6-6953-4d9e-ba02-8c7d00cfcaf1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquired lock "refresh_cache-126801e6-6953-4d9e-ba02-8c7d00cfcaf1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-8a6247b1-f77a-435a-8730-148e7c15829e req-66113e09-c657-4708-9e9d-52d55d2fc1f2 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Received event network-changed-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-8a6247b1-f77a-435a-8730-148e7c15829e req-66113e09-c657-4708-9e9d-52d55d2fc1f2 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Refreshing instance network info cache due to event network-changed-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8a6247b1-f77a-435a-8730-148e7c15829e req-66113e09-c657-4708-9e9d-52d55d2fc1f2 service nova] Acquiring lock "refresh_cache-126801e6-6953-4d9e-ba02-8c7d00cfcaf1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Updating instance_info_cache with network_info: [{"id": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "address": "fa:16:3e:96:73:47", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fc5b1b-e6", "ovs_interfaceid": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Releasing lock "refresh_cache-126801e6-6953-4d9e-ba02-8c7d00cfcaf1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Instance network_info: |[{"id": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "address": "fa:16:3e:96:73:47", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fc5b1b-e6", "ovs_interfaceid": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8a6247b1-f77a-435a-8730-148e7c15829e req-66113e09-c657-4708-9e9d-52d55d2fc1f2 service nova] Acquired lock "refresh_cache-126801e6-6953-4d9e-ba02-8c7d00cfcaf1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.network.neutron [req-8a6247b1-f77a-435a-8730-148e7c15829e req-66113e09-c657-4708-9e9d-52d55d2fc1f2 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Refreshing network info cache for port b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Start _get_guest_xml network_info=[{"id": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "address": "fa:16:3e:96:73:47", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fc5b1b-e6", "ovs_interfaceid": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:17:06 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:17:06 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1016775451',display_name='tempest-VolumesSnapshotTestJSON-instance-1016775451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1016775451',id=35,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEIXPfOe6T2SqZQ1lTsl1ZPJjq3jI9tjHmdNfYMp/6ovVv2UL3ururnCpTMNMzPlzCeqWKmVHCbbmUiyK+K14NaYoz8+VBdP4mKjVMsIPA9kojIbm5NyLMI7Azc2eSZFg==',key_name='tempest-keypair-2135250444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef43ca749d7c4576b084ddd6041c4c7f',ramdisk_id='',reservation_id='r-me2z6fdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-458554832',owner_user_name='tempest-VolumesSnapshotTestJSON-458554832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6f0b54327ff42f389ff059e65014340',uuid=126801e6-6953-4d9e-ba02-8c7d00cfcaf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "address": "fa:16:3e:96:73:47", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fc5b1b-e6", "ovs_interfaceid": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Converting VIF {"id": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "address": "fa:16:3e:96:73:47", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fc5b1b-e6", "ovs_interfaceid": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:73:47,bridge_name='br-int',has_traffic_filtering=True,id=b6fc5b1b-e640-4fa6-b74f-f588474d5fb5,network=Network(e1775143-19d2-4eab-920b-9f631d2248dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6fc5b1b-e6') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lazy-loading 'pci_devices' on Instance uuid 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:17:06 user nova-compute[71312]:   <uuid>126801e6-6953-4d9e-ba02-8c7d00cfcaf1</uuid>
Jul 25 10:17:06 user nova-compute[71312]:   <name>instance-00000023</name>
Jul 25 10:17:06 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:17:06 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:17:06 user nova-compute[71312]:   <metadata>
Jul 25 10:17:06 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:17:06 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:17:06 user nova-compute[71312]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1016775451</nova:name>
Jul 25 10:17:06 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:17:06</nova:creationTime>
Jul 25 10:17:06 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:17:06 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:17:06 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:17:06 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:17:06 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:17:06 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:17:06 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:17:06 user nova-compute[71312]:       <nova:owner>
Jul 25 10:17:06 user nova-compute[71312]:         <nova:user uuid="e6f0b54327ff42f389ff059e65014340">tempest-VolumesSnapshotTestJSON-458554832-project-member</nova:user>
Jul 25 10:17:06 user nova-compute[71312]:         <nova:project uuid="ef43ca749d7c4576b084ddd6041c4c7f">tempest-VolumesSnapshotTestJSON-458554832</nova:project>
Jul 25 10:17:06 user nova-compute[71312]:       </nova:owner>
Jul 25 10:17:06 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:17:06 user nova-compute[71312]:       <nova:ports>
Jul 25 10:17:06 user nova-compute[71312]:         <nova:port uuid="b6fc5b1b-e640-4fa6-b74f-f588474d5fb5">
Jul 25 10:17:06 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 10:17:06 user nova-compute[71312]:         </nova:port>
Jul 25 10:17:06 user nova-compute[71312]:       </nova:ports>
Jul 25 10:17:06 user nova-compute[71312]:     </nova:instance>
Jul 25 10:17:06 user nova-compute[71312]:   </metadata>
Jul 25 10:17:06 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:17:06 user nova-compute[71312]:     <system>
Jul 25 10:17:06 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:17:06 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:17:06 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:17:06 user nova-compute[71312]:       <entry name="serial">126801e6-6953-4d9e-ba02-8c7d00cfcaf1</entry>
Jul 25 10:17:06 user nova-compute[71312]:       <entry name="uuid">126801e6-6953-4d9e-ba02-8c7d00cfcaf1</entry>
Jul 25 10:17:06 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:17:06 user nova-compute[71312]:     </system>
Jul 25 10:17:06 user nova-compute[71312]:   </sysinfo>
Jul 25 10:17:06 user nova-compute[71312]:   <os>
Jul 25 10:17:06 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:17:06 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:17:06 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:17:06 user nova-compute[71312]:   </os>
Jul 25 10:17:06 user nova-compute[71312]:   <features>
Jul 25 10:17:06 user nova-compute[71312]:     <acpi/>
Jul 25 10:17:06 user nova-compute[71312]:     <apic/>
Jul 25 10:17:06 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:17:06 user nova-compute[71312]:   </features>
Jul 25 10:17:06 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:17:06 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:17:06 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:17:06 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:17:06 user nova-compute[71312]:   </clock>
Jul 25 10:17:06 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:17:06 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:17:06 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:17:06 user nova-compute[71312]:   </cpu>
Jul 25 10:17:06 user nova-compute[71312]:   <devices>
Jul 25 10:17:06 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:17:06 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:17:06 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk"/>
Jul 25 10:17:06 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:17:06 user nova-compute[71312]:     </disk>
Jul 25 10:17:06 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:17:06 user nova-compute[71312]:       <mac address="fa:16:3e:96:73:47"/>
Jul 25 10:17:06 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:17:06 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:17:06 user nova-compute[71312]:       <target dev="tapb6fc5b1b-e6"/>
Jul 25 10:17:06 user nova-compute[71312]:     </interface>
Jul 25 10:17:06 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:17:06 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/console.log" append="off"/>
Jul 25 10:17:06 user nova-compute[71312]:     </serial>
Jul 25 10:17:06 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:17:06 user nova-compute[71312]:     <video>
Jul 25 10:17:06 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:17:06 user nova-compute[71312]:     </video>
Jul 25 10:17:06 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:17:06 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:17:06 user nova-compute[71312]:     </rng>
Jul 25 10:17:06 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:17:06 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:17:06 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:17:06 user nova-compute[71312]:     </memballoon>
Jul 25 10:17:06 user nova-compute[71312]:   </devices>
Jul 25 10:17:06 user nova-compute[71312]: </domain>
Jul 25 10:17:06 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1016775451',display_name='tempest-VolumesSnapshotTestJSON-instance-1016775451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1016775451',id=35,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEIXPfOe6T2SqZQ1lTsl1ZPJjq3jI9tjHmdNfYMp/6ovVv2UL3ururnCpTMNMzPlzCeqWKmVHCbbmUiyK+K14NaYoz8+VBdP4mKjVMsIPA9kojIbm5NyLMI7Azc2eSZFg==',key_name='tempest-keypair-2135250444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef43ca749d7c4576b084ddd6041c4c7f',ramdisk_id='',reservation_id='r-me2z6fdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-458554832',owner_user_name='tempest-VolumesSnapshotTestJSON-458554832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6f0b54327ff42f389ff059e65014340',uuid=126801e6-6953-4d9e-ba02-8c7d00cfcaf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "address": "fa:16:3e:96:73:47", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fc5b1b-e6", "ovs_interfaceid": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Converting VIF {"id": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "address": "fa:16:3e:96:73:47", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fc5b1b-e6", "ovs_interfaceid": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:73:47,bridge_name='br-int',has_traffic_filtering=True,id=b6fc5b1b-e640-4fa6-b74f-f588474d5fb5,network=Network(e1775143-19d2-4eab-920b-9f631d2248dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6fc5b1b-e6') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG os_vif [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:73:47,bridge_name='br-int',has_traffic_filtering=True,id=b6fc5b1b-e640-4fa6-b74f-f588474d5fb5,network=Network(e1775143-19d2-4eab-920b-9f631d2248dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6fc5b1b-e6') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6fc5b1b-e6, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6fc5b1b-e6, col_values=(('external_ids', {'iface-id': 'b6fc5b1b-e640-4fa6-b74f-f588474d5fb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:73:47', 'vm-uuid': '126801e6-6953-4d9e-ba02-8c7d00cfcaf1'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:06 user nova-compute[71312]: INFO os_vif [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:73:47,bridge_name='br-int',has_traffic_filtering=True,id=b6fc5b1b-e640-4fa6-b74f-f588474d5fb5,network=Network(e1775143-19d2-4eab-920b-9f631d2248dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6fc5b1b-e6')
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:17:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] No VIF found with MAC fa:16:3e:96:73:47, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:17:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-8a6247b1-f77a-435a-8730-148e7c15829e req-66113e09-c657-4708-9e9d-52d55d2fc1f2 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Updated VIF entry in instance network info cache for port b6fc5b1b-e640-4fa6-b74f-f588474d5fb5. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:17:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-8a6247b1-f77a-435a-8730-148e7c15829e req-66113e09-c657-4708-9e9d-52d55d2fc1f2 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Updating instance_info_cache with network_info: [{"id": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "address": "fa:16:3e:96:73:47", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fc5b1b-e6", "ovs_interfaceid": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:17:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8a6247b1-f77a-435a-8730-148e7c15829e req-66113e09-c657-4708-9e9d-52d55d2fc1f2 service nova] Releasing lock "refresh_cache-126801e6-6953-4d9e-ba02-8c7d00cfcaf1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:17:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-8caa053a-df81-411e-b636-c1bd0f81d4b9 req-a572d5f3-9965-4c38-b8eb-a5f4582a6d16 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Received event network-vif-plugged-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8caa053a-df81-411e-b636-c1bd0f81d4b9 req-a572d5f3-9965-4c38-b8eb-a5f4582a6d16 service nova] Acquiring lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8caa053a-df81-411e-b636-c1bd0f81d4b9 req-a572d5f3-9965-4c38-b8eb-a5f4582a6d16 service nova] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8caa053a-df81-411e-b636-c1bd0f81d4b9 req-a572d5f3-9965-4c38-b8eb-a5f4582a6d16 service nova] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-8caa053a-df81-411e-b636-c1bd0f81d4b9 req-a572d5f3-9965-4c38-b8eb-a5f4582a6d16 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] No waiting events found dispatching network-vif-plugged-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:08 user nova-compute[71312]: WARNING nova.compute.manager [req-8caa053a-df81-411e-b636-c1bd0f81d4b9 req-a572d5f3-9965-4c38-b8eb-a5f4582a6d16 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Received unexpected event network-vif-plugged-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 for instance with vm_state building and task_state spawning.
Jul 25 10:17:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280230.2704566, 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:17:10 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] VM Resumed (Lifecycle Event)
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:17:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Instance spawned successfully.
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:17:10 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280230.270567, 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:17:10 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] VM Started (Lifecycle Event)
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:17:10 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:17:10 user nova-compute[71312]: INFO nova.compute.manager [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Took 5.58 seconds to spawn the instance on the hypervisor.
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-b08a206b-3841-4a3d-b1d5-07b6dd15234e req-3af4b27a-6a7f-458d-a640-cb275a0f519f service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Received event network-vif-plugged-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b08a206b-3841-4a3d-b1d5-07b6dd15234e req-3af4b27a-6a7f-458d-a640-cb275a0f519f service nova] Acquiring lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b08a206b-3841-4a3d-b1d5-07b6dd15234e req-3af4b27a-6a7f-458d-a640-cb275a0f519f service nova] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b08a206b-3841-4a3d-b1d5-07b6dd15234e req-3af4b27a-6a7f-458d-a640-cb275a0f519f service nova] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-b08a206b-3841-4a3d-b1d5-07b6dd15234e req-3af4b27a-6a7f-458d-a640-cb275a0f519f service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] No waiting events found dispatching network-vif-plugged-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:10 user nova-compute[71312]: WARNING nova.compute.manager [req-b08a206b-3841-4a3d-b1d5-07b6dd15234e req-3af4b27a-6a7f-458d-a640-cb275a0f519f service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Received unexpected event network-vif-plugged-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 for instance with vm_state building and task_state spawning.
Jul 25 10:17:10 user nova-compute[71312]: INFO nova.compute.manager [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Took 6.37 seconds to build instance.
Jul 25 10:17:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cec28b6-8846-495d-99a0-9d8a2e3ffc16 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.481s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:15 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280220.699837, 80e8cdf1-c86a-43aa-a66c-46af281187a5 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:17:15 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] VM Stopped (Lifecycle Event)
Jul 25 10:17:15 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280220.7171605, bcc93774-32b0-4592-bf6a-d655bac21d39 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:17:15 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] VM Stopped (Lifecycle Event)
Jul 25 10:17:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ca97f1d4-5d7f-4901-8abd-45855dcbd2a7 None None] [instance: 80e8cdf1-c86a-43aa-a66c-46af281187a5] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:17:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5e7e041f-302d-4a34-a536-d5d51fce74dd None None] [instance: bcc93774-32b0-4592-bf6a-d655bac21d39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:17:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Acquiring lock "51dc74c6-c677-4e31-b537-8d9507118520" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "51dc74c6-c677-4e31-b537-8d9507118520" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Acquiring lock "51dc74c6-c677-4e31-b537-8d9507118520-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "51dc74c6-c677-4e31-b537-8d9507118520-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "51dc74c6-c677-4e31-b537-8d9507118520-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:28 user nova-compute[71312]: INFO nova.compute.manager [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Terminating instance
Jul 25 10:17:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-85fc0438-a398-4fd9-afc8-8f2824af82b1 req-502cbc01-79e7-45ac-8eac-b16d73120bd8 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Received event network-vif-unplugged-aa64f217-e75c-4107-9673-0ceeccf1cc6b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85fc0438-a398-4fd9-afc8-8f2824af82b1 req-502cbc01-79e7-45ac-8eac-b16d73120bd8 service nova] Acquiring lock "51dc74c6-c677-4e31-b537-8d9507118520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85fc0438-a398-4fd9-afc8-8f2824af82b1 req-502cbc01-79e7-45ac-8eac-b16d73120bd8 service nova] Lock "51dc74c6-c677-4e31-b537-8d9507118520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85fc0438-a398-4fd9-afc8-8f2824af82b1 req-502cbc01-79e7-45ac-8eac-b16d73120bd8 service nova] Lock "51dc74c6-c677-4e31-b537-8d9507118520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-85fc0438-a398-4fd9-afc8-8f2824af82b1 req-502cbc01-79e7-45ac-8eac-b16d73120bd8 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] No waiting events found dispatching network-vif-unplugged-aa64f217-e75c-4107-9673-0ceeccf1cc6b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-85fc0438-a398-4fd9-afc8-8f2824af82b1 req-502cbc01-79e7-45ac-8eac-b16d73120bd8 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Received event network-vif-unplugged-aa64f217-e75c-4107-9673-0ceeccf1cc6b for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:17:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Instance destroyed successfully.
Jul 25 10:17:28 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lazy-loading 'resources' on Instance uuid 51dc74c6-c677-4e31-b537-8d9507118520 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1528653433',display_name='tempest-VolumesNegativeTest-instance-1528653433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1528653433',id=33,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:15:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f572a6a185244889965c370562a0339',ramdisk_id='',reservation_id='r-2u02jokr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-982996085',owner_user_name='tempest-VolumesNegativeTest-982996085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:15:45Z,user_data=None,user_id='3ba662e4b3ba4e46857d4e2fa9f2bc86',uuid=51dc74c6-c677-4e31-b537-8d9507118520,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "address": "fa:16:3e:7e:60:37", "network": {"id": "1133ac57-1fca-440d-b1c8-d90a64b1bca3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4c23af42fc11471fb11ccf88d9e96d71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa64f217-e7", "ovs_interfaceid": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Converting VIF {"id": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "address": "fa:16:3e:7e:60:37", "network": {"id": "1133ac57-1fca-440d-b1c8-d90a64b1bca3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4c23af42fc11471fb11ccf88d9e96d71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa64f217-e7", "ovs_interfaceid": "aa64f217-e75c-4107-9673-0ceeccf1cc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:60:37,bridge_name='br-int',has_traffic_filtering=True,id=aa64f217-e75c-4107-9673-0ceeccf1cc6b,network=Network(1133ac57-1fca-440d-b1c8-d90a64b1bca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa64f217-e7') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG os_vif [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:60:37,bridge_name='br-int',has_traffic_filtering=True,id=aa64f217-e75c-4107-9673-0ceeccf1cc6b,network=Network(1133ac57-1fca-440d-b1c8-d90a64b1bca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa64f217-e7') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa64f217-e7, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:17:28 user nova-compute[71312]: INFO os_vif [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:60:37,bridge_name='br-int',has_traffic_filtering=True,id=aa64f217-e75c-4107-9673-0ceeccf1cc6b,network=Network(1133ac57-1fca-440d-b1c8-d90a64b1bca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa64f217-e7')
Jul 25 10:17:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Deleting instance files /opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520_del
Jul 25 10:17:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Deletion of /opt/stack/data/nova/instances/51dc74c6-c677-4e31-b537-8d9507118520_del complete
Jul 25 10:17:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:17:28 user nova-compute[71312]: INFO nova.compute.manager [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Took 0.67 seconds to destroy the instance on the hypervisor.
Jul 25 10:17:28 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-2e01c123-09c0-4a29-abf0-727f61484747" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-2e01c123-09c0-4a29-abf0-727f61484747" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:17:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:17:29 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:17:29 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Took 0.55 seconds to deallocate network for instance.
Jul 25 10:17:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Updating instance_info_cache with network_info: [{"id": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "address": "fa:16:3e:b4:f1:6b", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22e0953e-fa", "ovs_interfaceid": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:17:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-31e213ef-5d45-43b5-9f47-7de4a2a137e6 req-2bc62351-3e9a-4fcd-af81-396f0a21d115 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Received event network-vif-deleted-aa64f217-e75c-4107-9673-0ceeccf1cc6b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-2e01c123-09c0-4a29-abf0-727f61484747" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:17:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:17:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:17:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:17:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:29 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:17:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:17:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:29 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Deleted allocations for instance 51dc74c6-c677-4e31-b537-8d9507118520
Jul 25 10:17:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:17:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7357c968-f557-4e90-8d66-7ecb4850c2ac tempest-VolumesNegativeTest-982996085 tempest-VolumesNegativeTest-982996085-project-member] Lock "51dc74c6-c677-4e31-b537-8d9507118520" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.708s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-4f7af2e4-9db6-48a3-92c5-ff8b91aaa7ff req-b43572f2-0210-4a9a-b78a-689fe7c288c5 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Received event network-vif-plugged-aa64f217-e75c-4107-9673-0ceeccf1cc6b {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4f7af2e4-9db6-48a3-92c5-ff8b91aaa7ff req-b43572f2-0210-4a9a-b78a-689fe7c288c5 service nova] Acquiring lock "51dc74c6-c677-4e31-b537-8d9507118520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4f7af2e4-9db6-48a3-92c5-ff8b91aaa7ff req-b43572f2-0210-4a9a-b78a-689fe7c288c5 service nova] Lock "51dc74c6-c677-4e31-b537-8d9507118520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4f7af2e4-9db6-48a3-92c5-ff8b91aaa7ff req-b43572f2-0210-4a9a-b78a-689fe7c288c5 service nova] Lock "51dc74c6-c677-4e31-b537-8d9507118520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-4f7af2e4-9db6-48a3-92c5-ff8b91aaa7ff req-b43572f2-0210-4a9a-b78a-689fe7c288c5 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] No waiting events found dispatching network-vif-plugged-aa64f217-e75c-4107-9673-0ceeccf1cc6b {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:30 user nova-compute[71312]: WARNING nova.compute.manager [req-4f7af2e4-9db6-48a3-92c5-ff8b91aaa7ff req-b43572f2-0210-4a9a-b78a-689fe7c288c5 service nova] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Received unexpected event network-vif-plugged-aa64f217-e75c-4107-9673-0ceeccf1cc6b for instance with vm_state deleted and task_state None.
Jul 25 10:17:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:17:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:17:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:17:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:17:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:17:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:17:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:37 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:17:37 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:17:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7609MB free_disk=25.060726165771484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 2e01c123-09c0-4a29-abf0-727f61484747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f5aa6ae1-551a-4f51-a29f-14612f9b17e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b8e398f8-9e73-4077-a773-fdd1e494d37f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 93222ef6-cba1-4427-a573-5c60c718db6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 7a96ad84-e354-49bf-8234-0edcfa435ae9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:17:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:38 user nova-compute[71312]: INFO nova.compute.manager [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Terminating instance
Jul 25 10:17:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-97e73116-344f-4fa9-bca9-3e495ccc7fec req-0de1e9e1-4f66-418a-81ea-42e5f1917ee8 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-vif-unplugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97e73116-344f-4fa9-bca9-3e495ccc7fec req-0de1e9e1-4f66-418a-81ea-42e5f1917ee8 service nova] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97e73116-344f-4fa9-bca9-3e495ccc7fec req-0de1e9e1-4f66-418a-81ea-42e5f1917ee8 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97e73116-344f-4fa9-bca9-3e495ccc7fec req-0de1e9e1-4f66-418a-81ea-42e5f1917ee8 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-97e73116-344f-4fa9-bca9-3e495ccc7fec req-0de1e9e1-4f66-418a-81ea-42e5f1917ee8 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] No waiting events found dispatching network-vif-unplugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-97e73116-344f-4fa9-bca9-3e495ccc7fec req-0de1e9e1-4f66-418a-81ea-42e5f1917ee8 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-vif-unplugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:17:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Instance destroyed successfully.
Jul 25 10:17:39 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'resources' on Instance uuid b8e398f8-9e73-4077-a773-fdd1e494d37f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:12:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-580576116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-580576116',id=28,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:14:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b14fcd7739f41eabc9e7120f5b58a08',ramdisk_id='',reservation_id='r-h0xu7vza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-13369838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:15:52Z,user_data=None,user_id='96d25383d4b6448da2d30479a26bfa0f',uuid=b8e398f8-9e73-4077-a773-fdd1e494d37f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converting VIF {"id": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "address": "fa:16:3e:9d:94:99", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f60d81-93", "ovs_interfaceid": "39f60d81-9344-4fc4-917d-aa4dc290a5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=39f60d81-9344-4fc4-917d-aa4dc290a5e0,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f60d81-93') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_vif [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=39f60d81-9344-4fc4-917d-aa4dc290a5e0,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f60d81-93') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39f60d81-93, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:17:39 user nova-compute[71312]: INFO os_vif [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=39f60d81-9344-4fc4-917d-aa4dc290a5e0,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f60d81-93')
Jul 25 10:17:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXVkBRZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:17:39 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6395970b-9717-432e-bc2f-7d2bd39eb06a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:17:39 user nova-compute[71312]: No targets found.
Jul 25 10:17:39 user nova-compute[71312]: iSNS:
Jul 25 10:17:39 user nova-compute[71312]: No targets found.
Jul 25 10:17:39 user nova-compute[71312]: STATIC:
Jul 25 10:17:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:17:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:17:39 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:17:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24
Jul 25 10:17:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:17:39 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:17:39 user nova-compute[71312]: FIRMWARE:
Jul 25 10:17:39 user nova-compute[71312]: No targets found.
Jul 25 10:17:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:17:39 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:17:39 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12b7726-1bc7-4c3f-9004-9854aba23714]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[54240d08-653e-4c9d-8102-94c4d5c79513]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:17:39 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:17:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:17:39 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 (non-flash)
Jul 25 10:17:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c0164c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6619fd-4c48-455b-9a86-4055ed1378ff]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e8c396-388a-4a0c-8de1-df1ae0a1dfe0]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b67178-61d1-4e02-ba3c-b07e803bd321]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb5c1c3-ea96-41d1-a221-9d43c3db9390]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f973bd56',) {{(pid=82549) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c1d933-81ff-4e01-8bc7-5776a098a8af]: (4, None) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1324e7-5062-4bd7-aaa1-3a4122a926d7]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad247bf4-84e1-4bdc-8076-f5472c067821]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24, portal: 172.16.0.220,3260]
Jul 25 10:17:39 user nova-compute[71312]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24, portal: 172.16.0.220,3260] successful.
Jul 25 10:17:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44ec3b2-0b4c-47ca-baa4-45cd5704cc24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34374cb-85df-4ffd-bbc6-c6d793056843]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] <== disconnect_volume: return (312ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:17:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Deleting instance files /opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f_del
Jul 25 10:17:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Deletion of /opt/stack/data/nova/instances/b8e398f8-9e73-4077-a773-fdd1e494d37f_del complete
Jul 25 10:17:39 user nova-compute[71312]: INFO nova.compute.manager [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Took 1.23 seconds to destroy the instance on the hypervisor.
Jul 25 10:17:39 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:17:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:40 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:17:40 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Took 0.79 seconds to deallocate network for instance.
Jul 25 10:17:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-2b9b106c-b097-4a6f-80ab-37fc0253c009 req-9613945c-6845-4462-aafb-c02916368180 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2b9b106c-b097-4a6f-80ab-37fc0253c009 req-9613945c-6845-4462-aafb-c02916368180 service nova] Acquiring lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2b9b106c-b097-4a6f-80ab-37fc0253c009 req-9613945c-6845-4462-aafb-c02916368180 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2b9b106c-b097-4a6f-80ab-37fc0253c009 req-9613945c-6845-4462-aafb-c02916368180 service nova] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-2b9b106c-b097-4a6f-80ab-37fc0253c009 req-9613945c-6845-4462-aafb-c02916368180 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] No waiting events found dispatching network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:17:40 user nova-compute[71312]: WARNING nova.compute.manager [req-2b9b106c-b097-4a6f-80ab-37fc0253c009 req-9613945c-6845-4462-aafb-c02916368180 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received unexpected event network-vif-plugged-39f60d81-9344-4fc4-917d-aa4dc290a5e0 for instance with vm_state active and task_state deleting.
Jul 25 10:17:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-2b9b106c-b097-4a6f-80ab-37fc0253c009 req-9613945c-6845-4462-aafb-c02916368180 service nova] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Received event network-vif-deleted-39f60d81-9344-4fc4-917d-aa4dc290a5e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:17:41 user nova-compute[71312]: INFO nova.compute.manager [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Took 0.74 seconds to detach 1 volumes for instance.
Jul 25 10:17:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:17:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:17:41 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:17:41 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:17:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:41 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Deleted allocations for instance b8e398f8-9e73-4077-a773-fdd1e494d37f
Jul 25 10:17:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9228160c-e1ef-49c6-aa81-2545783eec55 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "b8e398f8-9e73-4077-a773-fdd1e494d37f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.169s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:17:43 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280248.7977374, 51dc74c6-c677-4e31-b537-8d9507118520 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:17:43 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] VM Stopped (Lifecycle Event)
Jul 25 10:17:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b62bf6cb-4e57-4851-9e5c-90009d50c90f None None] [instance: 51dc74c6-c677-4e31-b537-8d9507118520] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:17:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:17:54 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280259.2130978, b8e398f8-9e73-4077-a773-fdd1e494d37f => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:17:54 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] VM Stopped (Lifecycle Event)
Jul 25 10:17:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-76de4a02-0baf-4bed-827f-acff849e6d36 None None] [instance: b8e398f8-9e73-4077-a773-fdd1e494d37f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:17:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:17:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:18:06 user nova-compute[71312]: INFO nova.compute.claims [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Claim successful on node user
Jul 25 10:18:06 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "b92c3f88-c9c0-4961-8b53-511c215bed39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:18:06 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:18:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG nova.policy [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc43767776ce4c9daf58530d543b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce6203d47944c3cb5bca9ab1c173192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:18:06 user nova-compute[71312]: INFO nova.compute.claims [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Claim successful on node user
Jul 25 10:18:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:18:06 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Creating image(s)
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "/opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "/opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "/opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk 1073741824" returned: 0 in 0.058s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.174s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Successfully created port: a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Cannot resize image /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'migration_context' on Instance uuid 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:18:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Ensure instance console log exists: /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.policy [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc43767776ce4c9daf58530d543b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce6203d47944c3cb5bca9ab1c173192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:18:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Creating image(s)
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "/opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "/opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "/opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk 1073741824" returned: 0 in 0.067s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.173s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Cannot resize image /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'migration_context' on Instance uuid b92c3f88-c9c0-4961-8b53-511c215bed39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Successfully created port: 6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Ensure instance console log exists: /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Successfully updated port: a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquired lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-876926c4-2c14-4aa7-88be-a702a8c19ddd req-10e3299a-d6f9-4084-8e29-047566199912 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-changed-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-876926c4-2c14-4aa7-88be-a702a8c19ddd req-10e3299a-d6f9-4084-8e29-047566199912 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Refreshing instance network info cache due to event network-changed-a2b2a233-ed89-4660-b554-fb9e3260c20f. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-876926c4-2c14-4aa7-88be-a702a8c19ddd req-10e3299a-d6f9-4084-8e29-047566199912 service nova] Acquiring lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Updating instance_info_cache with network_info: [{"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Releasing lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Instance network_info: |[{"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-876926c4-2c14-4aa7-88be-a702a8c19ddd req-10e3299a-d6f9-4084-8e29-047566199912 service nova] Acquired lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.network.neutron [req-876926c4-2c14-4aa7-88be-a702a8c19ddd req-10e3299a-d6f9-4084-8e29-047566199912 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Refreshing network info cache for port a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Start _get_guest_xml network_info=[{"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:18:08 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:18:08 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:18:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1913416426',display_name='tempest-ServerRescueNegativeTestJSON-server-1913416426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1913416426',id=36,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce6203d47944c3cb5bca9ab1c173192',ramdisk_id='',reservation_id='r-oatv27me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1328366493',owner_user_name='tempest-ServerRescueNegativeTestJSON-1328366493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:18:07Z,user_data=None,user_id='fc43767776ce4c9daf58530d543b0e3f',uuid=68165a49-f7f7-48b2-b7a0-34c09c6e8d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converting VIF {"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:24:56,bridge_name='br-int',has_traffic_filtering=True,id=a2b2a233-ed89-4660-b554-fb9e3260c20f,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b2a233-ed') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'pci_devices' on Instance uuid 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:18:08 user nova-compute[71312]:   <uuid>68165a49-f7f7-48b2-b7a0-34c09c6e8d2f</uuid>
Jul 25 10:18:08 user nova-compute[71312]:   <name>instance-00000024</name>
Jul 25 10:18:08 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:18:08 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:18:08 user nova-compute[71312]:   <metadata>
Jul 25 10:18:08 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:18:08 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:18:08 user nova-compute[71312]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1913416426</nova:name>
Jul 25 10:18:08 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:18:08</nova:creationTime>
Jul 25 10:18:08 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:18:08 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:18:08 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:18:08 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:18:08 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:18:08 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:18:08 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:18:08 user nova-compute[71312]:       <nova:owner>
Jul 25 10:18:08 user nova-compute[71312]:         <nova:user uuid="fc43767776ce4c9daf58530d543b0e3f">tempest-ServerRescueNegativeTestJSON-1328366493-project-member</nova:user>
Jul 25 10:18:08 user nova-compute[71312]:         <nova:project uuid="3ce6203d47944c3cb5bca9ab1c173192">tempest-ServerRescueNegativeTestJSON-1328366493</nova:project>
Jul 25 10:18:08 user nova-compute[71312]:       </nova:owner>
Jul 25 10:18:08 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:18:08 user nova-compute[71312]:       <nova:ports>
Jul 25 10:18:08 user nova-compute[71312]:         <nova:port uuid="a2b2a233-ed89-4660-b554-fb9e3260c20f">
Jul 25 10:18:08 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 10:18:08 user nova-compute[71312]:         </nova:port>
Jul 25 10:18:08 user nova-compute[71312]:       </nova:ports>
Jul 25 10:18:08 user nova-compute[71312]:     </nova:instance>
Jul 25 10:18:08 user nova-compute[71312]:   </metadata>
Jul 25 10:18:08 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:18:08 user nova-compute[71312]:     <system>
Jul 25 10:18:08 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:18:08 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:18:08 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:18:08 user nova-compute[71312]:       <entry name="serial">68165a49-f7f7-48b2-b7a0-34c09c6e8d2f</entry>
Jul 25 10:18:08 user nova-compute[71312]:       <entry name="uuid">68165a49-f7f7-48b2-b7a0-34c09c6e8d2f</entry>
Jul 25 10:18:08 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:18:08 user nova-compute[71312]:     </system>
Jul 25 10:18:08 user nova-compute[71312]:   </sysinfo>
Jul 25 10:18:08 user nova-compute[71312]:   <os>
Jul 25 10:18:08 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:18:08 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:18:08 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:18:08 user nova-compute[71312]:   </os>
Jul 25 10:18:08 user nova-compute[71312]:   <features>
Jul 25 10:18:08 user nova-compute[71312]:     <acpi/>
Jul 25 10:18:08 user nova-compute[71312]:     <apic/>
Jul 25 10:18:08 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:18:08 user nova-compute[71312]:   </features>
Jul 25 10:18:08 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:18:08 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:18:08 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:18:08 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:18:08 user nova-compute[71312]:   </clock>
Jul 25 10:18:08 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:18:08 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:18:08 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:18:08 user nova-compute[71312]:   </cpu>
Jul 25 10:18:08 user nova-compute[71312]:   <devices>
Jul 25 10:18:08 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:18:08 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:18:08 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk"/>
Jul 25 10:18:08 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:18:08 user nova-compute[71312]:     </disk>
Jul 25 10:18:08 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:18:08 user nova-compute[71312]:       <mac address="fa:16:3e:65:24:56"/>
Jul 25 10:18:08 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:18:08 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:18:08 user nova-compute[71312]:       <target dev="tapa2b2a233-ed"/>
Jul 25 10:18:08 user nova-compute[71312]:     </interface>
Jul 25 10:18:08 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:18:08 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/console.log" append="off"/>
Jul 25 10:18:08 user nova-compute[71312]:     </serial>
Jul 25 10:18:08 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:18:08 user nova-compute[71312]:     <video>
Jul 25 10:18:08 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:18:08 user nova-compute[71312]:     </video>
Jul 25 10:18:08 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:18:08 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:18:08 user nova-compute[71312]:     </rng>
Jul 25 10:18:08 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:18:08 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:18:08 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:18:08 user nova-compute[71312]:     </memballoon>
Jul 25 10:18:08 user nova-compute[71312]:   </devices>
Jul 25 10:18:08 user nova-compute[71312]: </domain>
Jul 25 10:18:08 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:18:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1913416426',display_name='tempest-ServerRescueNegativeTestJSON-server-1913416426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1913416426',id=36,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce6203d47944c3cb5bca9ab1c173192',ramdisk_id='',reservation_id='r-oatv27me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1328366493',owner_user_name='tempest-ServerRescueNegativeTestJSON-1328366493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:18:07Z,user_data=None,user_id='fc43767776ce4c9daf58530d543b0e3f',uuid=68165a49-f7f7-48b2-b7a0-34c09c6e8d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converting VIF {"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:24:56,bridge_name='br-int',has_traffic_filtering=True,id=a2b2a233-ed89-4660-b554-fb9e3260c20f,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b2a233-ed') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG os_vif [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:24:56,bridge_name='br-int',has_traffic_filtering=True,id=a2b2a233-ed89-4660-b554-fb9e3260c20f,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b2a233-ed') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2b2a233-ed, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa2b2a233-ed, col_values=(('external_ids', {'iface-id': 'a2b2a233-ed89-4660-b554-fb9e3260c20f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:24:56', 'vm-uuid': '68165a49-f7f7-48b2-b7a0-34c09c6e8d2f'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:08 user nova-compute[71312]: INFO os_vif [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:24:56,bridge_name='br-int',has_traffic_filtering=True,id=a2b2a233-ed89-4660-b554-fb9e3260c20f,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b2a233-ed')
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:18:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No VIF found with MAC fa:16:3e:65:24:56, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Successfully updated port: 6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquired lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-c8e3837f-82fc-4baa-b6bf-fcbea2d5a5a9 req-9107eee7-2472-49e5-a76c-dc0d8d74aad1 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received event network-changed-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-c8e3837f-82fc-4baa-b6bf-fcbea2d5a5a9 req-9107eee7-2472-49e5-a76c-dc0d8d74aad1 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Refreshing instance network info cache due to event network-changed-6ddfb07b-8e9d-48a1-b8c9-96084b7068db. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c8e3837f-82fc-4baa-b6bf-fcbea2d5a5a9 req-9107eee7-2472-49e5-a76c-dc0d8d74aad1 service nova] Acquiring lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-876926c4-2c14-4aa7-88be-a702a8c19ddd req-10e3299a-d6f9-4084-8e29-047566199912 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Updated VIF entry in instance network info cache for port a2b2a233-ed89-4660-b554-fb9e3260c20f. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-876926c4-2c14-4aa7-88be-a702a8c19ddd req-10e3299a-d6f9-4084-8e29-047566199912 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Updating instance_info_cache with network_info: [{"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-876926c4-2c14-4aa7-88be-a702a8c19ddd req-10e3299a-d6f9-4084-8e29-047566199912 service nova] Releasing lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Updating instance_info_cache with network_info: [{"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Releasing lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Instance network_info: |[{"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c8e3837f-82fc-4baa-b6bf-fcbea2d5a5a9 req-9107eee7-2472-49e5-a76c-dc0d8d74aad1 service nova] Acquired lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-c8e3837f-82fc-4baa-b6bf-fcbea2d5a5a9 req-9107eee7-2472-49e5-a76c-dc0d8d74aad1 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Refreshing network info cache for port 6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Start _get_guest_xml network_info=[{"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:18:09 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:18:09 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-408213321',display_name='tempest-ServerRescueNegativeTestJSON-server-408213321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-408213321',id=37,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce6203d47944c3cb5bca9ab1c173192',ramdisk_id='',reservation_id='r-0osvifav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1328366493',owner_user_name='tempest-ServerRescueNegativeTestJSON-1328366493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:18:08Z,user_data=None,user_id='fc43767776ce4c9daf58530d543b0e3f',uuid=b92c3f88-c9c0-4961-8b53-511c215bed39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converting VIF {"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:36:c6,bridge_name='br-int',has_traffic_filtering=True,id=6ddfb07b-8e9d-48a1-b8c9-96084b7068db,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddfb07b-8e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'pci_devices' on Instance uuid b92c3f88-c9c0-4961-8b53-511c215bed39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:18:09 user nova-compute[71312]:   <uuid>b92c3f88-c9c0-4961-8b53-511c215bed39</uuid>
Jul 25 10:18:09 user nova-compute[71312]:   <name>instance-00000025</name>
Jul 25 10:18:09 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:18:09 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:18:09 user nova-compute[71312]:   <metadata>
Jul 25 10:18:09 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:18:09 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:18:09 user nova-compute[71312]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-408213321</nova:name>
Jul 25 10:18:09 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:18:09</nova:creationTime>
Jul 25 10:18:09 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:18:09 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:18:09 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:18:09 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:18:09 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:18:09 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:18:09 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:18:09 user nova-compute[71312]:       <nova:owner>
Jul 25 10:18:09 user nova-compute[71312]:         <nova:user uuid="fc43767776ce4c9daf58530d543b0e3f">tempest-ServerRescueNegativeTestJSON-1328366493-project-member</nova:user>
Jul 25 10:18:09 user nova-compute[71312]:         <nova:project uuid="3ce6203d47944c3cb5bca9ab1c173192">tempest-ServerRescueNegativeTestJSON-1328366493</nova:project>
Jul 25 10:18:09 user nova-compute[71312]:       </nova:owner>
Jul 25 10:18:09 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:18:09 user nova-compute[71312]:       <nova:ports>
Jul 25 10:18:09 user nova-compute[71312]:         <nova:port uuid="6ddfb07b-8e9d-48a1-b8c9-96084b7068db">
Jul 25 10:18:09 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 10:18:09 user nova-compute[71312]:         </nova:port>
Jul 25 10:18:09 user nova-compute[71312]:       </nova:ports>
Jul 25 10:18:09 user nova-compute[71312]:     </nova:instance>
Jul 25 10:18:09 user nova-compute[71312]:   </metadata>
Jul 25 10:18:09 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:18:09 user nova-compute[71312]:     <system>
Jul 25 10:18:09 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:18:09 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:18:09 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:18:09 user nova-compute[71312]:       <entry name="serial">b92c3f88-c9c0-4961-8b53-511c215bed39</entry>
Jul 25 10:18:09 user nova-compute[71312]:       <entry name="uuid">b92c3f88-c9c0-4961-8b53-511c215bed39</entry>
Jul 25 10:18:09 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:18:09 user nova-compute[71312]:     </system>
Jul 25 10:18:09 user nova-compute[71312]:   </sysinfo>
Jul 25 10:18:09 user nova-compute[71312]:   <os>
Jul 25 10:18:09 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:18:09 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:18:09 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:18:09 user nova-compute[71312]:   </os>
Jul 25 10:18:09 user nova-compute[71312]:   <features>
Jul 25 10:18:09 user nova-compute[71312]:     <acpi/>
Jul 25 10:18:09 user nova-compute[71312]:     <apic/>
Jul 25 10:18:09 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:18:09 user nova-compute[71312]:   </features>
Jul 25 10:18:09 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:18:09 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:18:09 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:18:09 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:18:09 user nova-compute[71312]:   </clock>
Jul 25 10:18:09 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:18:09 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:18:09 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:18:09 user nova-compute[71312]:   </cpu>
Jul 25 10:18:09 user nova-compute[71312]:   <devices>
Jul 25 10:18:09 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:18:09 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:18:09 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk"/>
Jul 25 10:18:09 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:18:09 user nova-compute[71312]:     </disk>
Jul 25 10:18:09 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:18:09 user nova-compute[71312]:       <mac address="fa:16:3e:01:36:c6"/>
Jul 25 10:18:09 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:18:09 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:18:09 user nova-compute[71312]:       <target dev="tap6ddfb07b-8e"/>
Jul 25 10:18:09 user nova-compute[71312]:     </interface>
Jul 25 10:18:09 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:18:09 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/console.log" append="off"/>
Jul 25 10:18:09 user nova-compute[71312]:     </serial>
Jul 25 10:18:09 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:18:09 user nova-compute[71312]:     <video>
Jul 25 10:18:09 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:18:09 user nova-compute[71312]:     </video>
Jul 25 10:18:09 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:18:09 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:18:09 user nova-compute[71312]:     </rng>
Jul 25 10:18:09 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:18:09 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:18:09 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:18:09 user nova-compute[71312]:     </memballoon>
Jul 25 10:18:09 user nova-compute[71312]:   </devices>
Jul 25 10:18:09 user nova-compute[71312]: </domain>
Jul 25 10:18:09 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-408213321',display_name='tempest-ServerRescueNegativeTestJSON-server-408213321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-408213321',id=37,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce6203d47944c3cb5bca9ab1c173192',ramdisk_id='',reservation_id='r-0osvifav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1328366493',owner_user_name='tempest-ServerRescueNegativeTestJSON-1328366493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:18:08Z,user_data=None,user_id='fc43767776ce4c9daf58530d543b0e3f',uuid=b92c3f88-c9c0-4961-8b53-511c215bed39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converting VIF {"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:36:c6,bridge_name='br-int',has_traffic_filtering=True,id=6ddfb07b-8e9d-48a1-b8c9-96084b7068db,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddfb07b-8e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG os_vif [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:36:c6,bridge_name='br-int',has_traffic_filtering=True,id=6ddfb07b-8e9d-48a1-b8c9-96084b7068db,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddfb07b-8e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ddfb07b-8e, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ddfb07b-8e, col_values=(('external_ids', {'iface-id': '6ddfb07b-8e9d-48a1-b8c9-96084b7068db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:36:c6', 'vm-uuid': 'b92c3f88-c9c0-4961-8b53-511c215bed39'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:09 user nova-compute[71312]: INFO os_vif [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:36:c6,bridge_name='br-int',has_traffic_filtering=True,id=6ddfb07b-8e9d-48a1-b8c9-96084b7068db,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddfb07b-8e')
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No VIF found with MAC fa:16:3e:01:36:c6, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:18:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:10 user nova-compute[71312]: DEBUG nova.network.neutron [req-c8e3837f-82fc-4baa-b6bf-fcbea2d5a5a9 req-9107eee7-2472-49e5-a76c-dc0d8d74aad1 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Updated VIF entry in instance network info cache for port 6ddfb07b-8e9d-48a1-b8c9-96084b7068db. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:18:10 user nova-compute[71312]: DEBUG nova.network.neutron [req-c8e3837f-82fc-4baa-b6bf-fcbea2d5a5a9 req-9107eee7-2472-49e5-a76c-dc0d8d74aad1 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Updating instance_info_cache with network_info: [{"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:18:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c8e3837f-82fc-4baa-b6bf-fcbea2d5a5a9 req-9107eee7-2472-49e5-a76c-dc0d8d74aad1 service nova] Releasing lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:18:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-6ce10984-4a74-42d2-b948-19bb909312ce req-6040ef6c-74bd-4806-afa4-241012bd9ed7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:18:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6ce10984-4a74-42d2-b948-19bb909312ce req-6040ef6c-74bd-4806-afa4-241012bd9ed7 service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6ce10984-4a74-42d2-b948-19bb909312ce req-6040ef6c-74bd-4806-afa4-241012bd9ed7 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6ce10984-4a74-42d2-b948-19bb909312ce req-6040ef6c-74bd-4806-afa4-241012bd9ed7 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-6ce10984-4a74-42d2-b948-19bb909312ce req-6040ef6c-74bd-4806-afa4-241012bd9ed7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:18:10 user nova-compute[71312]: WARNING nova.compute.manager [req-6ce10984-4a74-42d2-b948-19bb909312ce req-6040ef6c-74bd-4806-afa4-241012bd9ed7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state building and task_state spawning.
Jul 25 10:18:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:18:12 user nova-compute[71312]: WARNING nova.compute.manager [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state building and task_state spawning.
Jul 25 10:18:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received event network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] Acquiring lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] No waiting events found dispatching network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:18:12 user nova-compute[71312]: WARNING nova.compute.manager [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received unexpected event network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db for instance with vm_state building and task_state spawning.
Jul 25 10:18:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received event network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] Acquiring lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] No waiting events found dispatching network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:18:12 user nova-compute[71312]: WARNING nova.compute.manager [req-f575a12f-cec5-4c39-8ce1-462e0569d378 req-61d42e06-5157-423d-b093-6bb6531f9258 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received unexpected event network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db for instance with vm_state building and task_state spawning.
Jul 25 10:18:13 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280293.990819, 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:18:13 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] VM Resumed (Lifecycle Event)
Jul 25 10:18:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:18:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:18:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:18:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:18:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Instance spawned successfully.
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:18:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Instance spawned successfully.
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:18:14 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280293.9911475, 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:18:14 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] VM Started (Lifecycle Event)
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:18:14 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280293.9967508, b92c3f88-c9c0-4961-8b53-511c215bed39 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:18:14 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] VM Resumed (Lifecycle Event)
Jul 25 10:18:14 user nova-compute[71312]: INFO nova.compute.manager [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Took 7.41 seconds to spawn the instance on the hypervisor.
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:18:14 user nova-compute[71312]: INFO nova.compute.manager [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Took 6.56 seconds to spawn the instance on the hypervisor.
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:18:14 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280293.9973242, b92c3f88-c9c0-4961-8b53-511c215bed39 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:18:14 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] VM Started (Lifecycle Event)
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:18:14 user nova-compute[71312]: INFO nova.compute.manager [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Took 8.18 seconds to build instance.
Jul 25 10:18:14 user nova-compute[71312]: INFO nova.compute.manager [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Took 7.63 seconds to build instance.
Jul 25 10:18:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c759895-4427-43be-a206-e02b6d47e743 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.295s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3b70f512-e437-4c05-be61-4b1556ac1d18 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.749s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "93222ef6-cba1-4427-a573-5c60c718db6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "93222ef6-cba1-4427-a573-5c60c718db6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:18 user nova-compute[71312]: INFO nova.compute.manager [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Terminating instance
Jul 25 10:18:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:18:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-f7b61dad-9173-4a1d-b09b-36bc369de570 req-d2957954-5ec1-4f7e-b748-8e46b34a0a67 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received event network-vif-unplugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f7b61dad-9173-4a1d-b09b-36bc369de570 req-d2957954-5ec1-4f7e-b748-8e46b34a0a67 service nova] Acquiring lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f7b61dad-9173-4a1d-b09b-36bc369de570 req-d2957954-5ec1-4f7e-b748-8e46b34a0a67 service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f7b61dad-9173-4a1d-b09b-36bc369de570 req-d2957954-5ec1-4f7e-b748-8e46b34a0a67 service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-f7b61dad-9173-4a1d-b09b-36bc369de570 req-d2957954-5ec1-4f7e-b748-8e46b34a0a67 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] No waiting events found dispatching network-vif-unplugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-f7b61dad-9173-4a1d-b09b-36bc369de570 req-d2957954-5ec1-4f7e-b748-8e46b34a0a67 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received event network-vif-unplugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Instance destroyed successfully.
Jul 25 10:18:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lazy-loading 'resources' on Instance uuid 93222ef6-cba1-4427-a573-5c60c718db6c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-228881500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-228881500',id=31,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3sczLA5TKbRelOtXVy7Hu+NIHQiYpa4nIRDi8+uN/qpmvSpM06eC3ZMc4BnGKGdQ0gOA0/RlOXlsTKbDSS+wvNME5SfN19jMxh5OYgcmvDxupr9/mJ5883mO5uMk+UEA==',key_name='tempest-keypair-1429184951',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:16:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23211f867d6049f5bb1901e03e8dc396',ramdisk_id='',reservation_id='r-zkfj7ysk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1954806993',owner_user_name='tempest-AttachVolumeShelveTestJSON-1954806993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ec3ee9c206b43448eb6479cad0b437c',uuid=93222ef6-cba1-4427-a573-5c60c718db6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converting VIF {"id": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "address": "fa:16:3e:16:80:27", "network": {"id": "355851bc-551b-4ee6-a8a9-d138b852ed44", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-802990842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23211f867d6049f5bb1901e03e8dc396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db9b27-be", "ovs_interfaceid": "a8db9b27-beab-4c26-a2d9-cc428589bf62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:80:27,bridge_name='br-int',has_traffic_filtering=True,id=a8db9b27-beab-4c26-a2d9-cc428589bf62,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db9b27-be') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG os_vif [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:80:27,bridge_name='br-int',has_traffic_filtering=True,id=a8db9b27-beab-4c26-a2d9-cc428589bf62,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db9b27-be') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8db9b27-be, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:18:19 user nova-compute[71312]: INFO os_vif [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:80:27,bridge_name='br-int',has_traffic_filtering=True,id=a8db9b27-beab-4c26-a2d9-cc428589bf62,network=Network(355851bc-551b-4ee6-a8a9-d138b852ed44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db9b27-be')
Jul 25 10:18:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Deleting instance files /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c_del
Jul 25 10:18:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Deletion of /opt/stack/data/nova/instances/93222ef6-cba1-4427-a573-5c60c718db6c_del complete
Jul 25 10:18:19 user nova-compute[71312]: INFO nova.compute.manager [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Took 0.80 seconds to destroy the instance on the hypervisor.
Jul 25 10:18:19 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:18:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:20 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:18:20 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Took 1.05 seconds to deallocate network for instance.
Jul 25 10:18:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-e90e3035-f05b-4bfa-827b-7b43f69527f4 req-029ba1f3-d40c-44d2-9aca-bc93e63cbfa3 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received event network-vif-deleted-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:18:20 user nova-compute[71312]: INFO nova.compute.manager [req-e90e3035-f05b-4bfa-827b-7b43f69527f4 req-029ba1f3-d40c-44d2-9aca-bc93e63cbfa3 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Neutron deleted interface a8db9b27-beab-4c26-a2d9-cc428589bf62; detaching it from the instance and deleting it from the info cache
Jul 25 10:18:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-e90e3035-f05b-4bfa-827b-7b43f69527f4 req-029ba1f3-d40c-44d2-9aca-bc93e63cbfa3 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:18:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-e90e3035-f05b-4bfa-827b-7b43f69527f4 req-029ba1f3-d40c-44d2-9aca-bc93e63cbfa3 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Detach interface failed, port_id=a8db9b27-beab-4c26-a2d9-cc428589bf62, reason: Instance 93222ef6-cba1-4427-a573-5c60c718db6c could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:18:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:21 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:18:21 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:18:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:21 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Deleted allocations for instance 93222ef6-cba1-4427-a573-5c60c718db6c
Jul 25 10:18:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-87c3fd68-4d7d-4ae2-9c74-2d06746fa2ba tempest-AttachVolumeShelveTestJSON-1954806993 tempest-AttachVolumeShelveTestJSON-1954806993-project-member] Lock "93222ef6-cba1-4427-a573-5c60c718db6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.386s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-12c02da8-8748-4929-9759-9f2556e64f6c req-a072d082-8913-41e0-9712-446ef6779d27 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received event network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:18:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-12c02da8-8748-4929-9759-9f2556e64f6c req-a072d082-8913-41e0-9712-446ef6779d27 service nova] Acquiring lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-12c02da8-8748-4929-9759-9f2556e64f6c req-a072d082-8913-41e0-9712-446ef6779d27 service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-12c02da8-8748-4929-9759-9f2556e64f6c req-a072d082-8913-41e0-9712-446ef6779d27 service nova] Lock "93222ef6-cba1-4427-a573-5c60c718db6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-12c02da8-8748-4929-9759-9f2556e64f6c req-a072d082-8913-41e0-9712-446ef6779d27 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] No waiting events found dispatching network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:18:21 user nova-compute[71312]: WARNING nova.compute.manager [req-12c02da8-8748-4929-9759-9f2556e64f6c req-a072d082-8913-41e0-9712-446ef6779d27 service nova] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Received unexpected event network-vif-plugged-a8db9b27-beab-4c26-a2d9-cc428589bf62 for instance with vm_state deleted and task_state None.
Jul 25 10:18:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:18:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:18:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:18:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-f5aa6ae1-551a-4f51-a29f-14612f9b17e6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-f5aa6ae1-551a-4f51-a29f-14612f9b17e6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "2e01c123-09c0-4a29-abf0-727f61484747" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "2e01c123-09c0-4a29-abf0-727f61484747" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "2e01c123-09c0-4a29-abf0-727f61484747-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "2e01c123-09c0-4a29-abf0-727f61484747-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "2e01c123-09c0-4a29-abf0-727f61484747-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:29 user nova-compute[71312]: INFO nova.compute.manager [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Terminating instance
Jul 25 10:18:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Updating instance_info_cache with network_info: [{"id": "c26e10b5-2f15-45c8-9745-5556b19709a7", "address": "fa:16:3e:e3:1b:7d", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26e10b5-2f", "ovs_interfaceid": "c26e10b5-2f15-45c8-9745-5556b19709a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-f5aa6ae1-551a-4f51-a29f-14612f9b17e6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-3870e94d-95bf-4cd2-b759-203b4e362a9a req-5eb0d5b3-d2c5-4425-891f-95534ac249ad service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Received event network-vif-unplugged-22e0953e-fabd-4f5c-9ec7-157b5851e87d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3870e94d-95bf-4cd2-b759-203b4e362a9a req-5eb0d5b3-d2c5-4425-891f-95534ac249ad service nova] Acquiring lock "2e01c123-09c0-4a29-abf0-727f61484747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3870e94d-95bf-4cd2-b759-203b4e362a9a req-5eb0d5b3-d2c5-4425-891f-95534ac249ad service nova] Lock "2e01c123-09c0-4a29-abf0-727f61484747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3870e94d-95bf-4cd2-b759-203b4e362a9a req-5eb0d5b3-d2c5-4425-891f-95534ac249ad service nova] Lock "2e01c123-09c0-4a29-abf0-727f61484747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-3870e94d-95bf-4cd2-b759-203b4e362a9a req-5eb0d5b3-d2c5-4425-891f-95534ac249ad service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] No waiting events found dispatching network-vif-unplugged-22e0953e-fabd-4f5c-9ec7-157b5851e87d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-3870e94d-95bf-4cd2-b759-203b4e362a9a req-5eb0d5b3-d2c5-4425-891f-95534ac249ad service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Received event network-vif-unplugged-22e0953e-fabd-4f5c-9ec7-157b5851e87d for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:18:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Instance destroyed successfully.
Jul 25 10:18:30 user nova-compute[71312]: DEBUG nova.objects.instance [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'resources' on Instance uuid 2e01c123-09c0-4a29-abf0-727f61484747 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:18:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-415776193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-415776193',id=20,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:09:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b14fcd7739f41eabc9e7120f5b58a08',ramdisk_id='',reservation_id='r-zy3urfqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-13369838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:11:02Z,user_data=None,user_id='96d25383d4b6448da2d30479a26bfa0f',uuid=2e01c123-09c0-4a29-abf0-727f61484747,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "address": "fa:16:3e:b4:f1:6b", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22e0953e-fa", "ovs_interfaceid": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:18:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converting VIF {"id": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "address": "fa:16:3e:b4:f1:6b", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22e0953e-fa", "ovs_interfaceid": "22e0953e-fabd-4f5c-9ec7-157b5851e87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:18:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:f1:6b,bridge_name='br-int',has_traffic_filtering=True,id=22e0953e-fabd-4f5c-9ec7-157b5851e87d,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22e0953e-fa') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:18:30 user nova-compute[71312]: DEBUG os_vif [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:f1:6b,bridge_name='br-int',has_traffic_filtering=True,id=22e0953e-fabd-4f5c-9ec7-157b5851e87d,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22e0953e-fa') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:18:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22e0953e-fa, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:18:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:18:30 user nova-compute[71312]: INFO os_vif [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:f1:6b,bridge_name='br-int',has_traffic_filtering=True,id=22e0953e-fabd-4f5c-9ec7-157b5851e87d,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22e0953e-fa')
Jul 25 10:18:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Deleting instance files /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747_del
Jul 25 10:18:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Deletion of /opt/stack/data/nova/instances/2e01c123-09c0-4a29-abf0-727f61484747_del complete
Jul 25 10:18:30 user nova-compute[71312]: INFO nova.compute.manager [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 25 10:18:30 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:18:30 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:18:30 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:18:30 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:18:30 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Took 0.55 seconds to deallocate network for instance.
Jul 25 10:18:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-f5c75296-7e40-4d17-9cd1-6c32b382a9dc req-5f7daace-d0db-48a0-b206-e3becd353f62 service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Received event network-vif-deleted-22e0953e-fabd-4f5c-9ec7-157b5851e87d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:18:30 user nova-compute[71312]: INFO nova.compute.manager [req-f5c75296-7e40-4d17-9cd1-6c32b382a9dc req-5f7daace-d0db-48a0-b206-e3becd353f62 service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Neutron deleted interface 22e0953e-fabd-4f5c-9ec7-157b5851e87d; detaching it from the instance and deleting it from the info cache
Jul 25 10:18:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-f5c75296-7e40-4d17-9cd1-6c32b382a9dc req-5f7daace-d0db-48a0-b206-e3becd353f62 service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:18:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-f5c75296-7e40-4d17-9cd1-6c32b382a9dc req-5f7daace-d0db-48a0-b206-e3becd353f62 service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Detach interface failed, port_id=22e0953e-fabd-4f5c-9ec7-157b5851e87d, reason: Instance 2e01c123-09c0-4a29-abf0-727f61484747 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:18:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:31 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:18:31 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:18:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:31 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Deleted allocations for instance 2e01c123-09c0-4a29-abf0-727f61484747
Jul 25 10:18:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-42a1d8f5-b2b1-4878-8930-cd8cf32e58d3 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "2e01c123-09c0-4a29-abf0-727f61484747" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.862s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-e76ca3c2-ff71-4ddf-8469-a5c6afc89acf req-fcba880f-0a20-4711-bb22-7aa5f96a364a service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Received event network-vif-plugged-22e0953e-fabd-4f5c-9ec7-157b5851e87d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:18:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e76ca3c2-ff71-4ddf-8469-a5c6afc89acf req-fcba880f-0a20-4711-bb22-7aa5f96a364a service nova] Acquiring lock "2e01c123-09c0-4a29-abf0-727f61484747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e76ca3c2-ff71-4ddf-8469-a5c6afc89acf req-fcba880f-0a20-4711-bb22-7aa5f96a364a service nova] Lock "2e01c123-09c0-4a29-abf0-727f61484747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e76ca3c2-ff71-4ddf-8469-a5c6afc89acf req-fcba880f-0a20-4711-bb22-7aa5f96a364a service nova] Lock "2e01c123-09c0-4a29-abf0-727f61484747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-e76ca3c2-ff71-4ddf-8469-a5c6afc89acf req-fcba880f-0a20-4711-bb22-7aa5f96a364a service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] No waiting events found dispatching network-vif-plugged-22e0953e-fabd-4f5c-9ec7-157b5851e87d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:18:31 user nova-compute[71312]: WARNING nova.compute.manager [req-e76ca3c2-ff71-4ddf-8469-a5c6afc89acf req-fcba880f-0a20-4711-bb22-7aa5f96a364a service nova] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Received unexpected event network-vif-plugged-22e0953e-fabd-4f5c-9ec7-157b5851e87d for instance with vm_state deleted and task_state None.
Jul 25 10:18:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:18:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:18:34 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280299.412985, 93222ef6-cba1-4427-a573-5c60c718db6c => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:18:34 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] VM Stopped (Lifecycle Event)
Jul 25 10:18:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-277f5ced-946c-4d1b-b9d1-714e8227c095 None None] [instance: 93222ef6-cba1-4427-a573-5c60c718db6c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:18:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:18:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:18:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:37 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:18:37 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:18:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7697MB free_disk=25.154739379882812GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:18:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:18:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:18:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f5aa6ae1-551a-4f51-a29f-14612f9b17e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:18:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 7a96ad84-e354-49bf-8234-0edcfa435ae9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:18:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:18:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:18:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:18:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:18:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:18:38 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:18:38 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:18:38 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:18:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:18:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:45 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280310.1320202, 2e01c123-09c0-4a29-abf0-727f61484747 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:18:45 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] VM Stopped (Lifecycle Event)
Jul 25 10:18:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-335717ab-cf4c-4b05-bc66-7faf5fe31cc7 None None] [instance: 2e01c123-09c0-4a29-abf0-727f61484747] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:18:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-e181ff1b-9a1d-4b32-91cf-dac94f47a010 req-3b7a89ef-afd2-4772-90fd-a446bf4a531e service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Received event network-changed-27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:18:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-e181ff1b-9a1d-4b32-91cf-dac94f47a010 req-3b7a89ef-afd2-4772-90fd-a446bf4a531e service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Refreshing instance network info cache due to event network-changed-27d9fdcf-28a9-4c75-9369-d21fcf4313fd. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:18:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e181ff1b-9a1d-4b32-91cf-dac94f47a010 req-3b7a89ef-afd2-4772-90fd-a446bf4a531e service nova] Acquiring lock "refresh_cache-7a96ad84-e354-49bf-8234-0edcfa435ae9" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:18:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e181ff1b-9a1d-4b32-91cf-dac94f47a010 req-3b7a89ef-afd2-4772-90fd-a446bf4a531e service nova] Acquired lock "refresh_cache-7a96ad84-e354-49bf-8234-0edcfa435ae9" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:18:45 user nova-compute[71312]: DEBUG nova.network.neutron [req-e181ff1b-9a1d-4b32-91cf-dac94f47a010 req-3b7a89ef-afd2-4772-90fd-a446bf4a531e service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Refreshing network info cache for port 27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:18:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-e181ff1b-9a1d-4b32-91cf-dac94f47a010 req-3b7a89ef-afd2-4772-90fd-a446bf4a531e service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Updated VIF entry in instance network info cache for port 27d9fdcf-28a9-4c75-9369-d21fcf4313fd. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:18:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-e181ff1b-9a1d-4b32-91cf-dac94f47a010 req-3b7a89ef-afd2-4772-90fd-a446bf4a531e service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Updating instance_info_cache with network_info: [{"id": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "address": "fa:16:3e:95:f9:97", "network": {"id": "37efbc22-d431-443d-84e3-a6438b837541", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-753576595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b26f355fd1645049dae1f37866d4710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d9fdcf-28", "ovs_interfaceid": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:18:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e181ff1b-9a1d-4b32-91cf-dac94f47a010 req-3b7a89ef-afd2-4772-90fd-a446bf4a531e service nova] Releasing lock "refresh_cache-7a96ad84-e354-49bf-8234-0edcfa435ae9" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:18:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lazy-loading 'flavor' on Instance uuid 7a96ad84-e354-49bf-8234-0edcfa435ae9 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:52 user nova-compute[71312]: INFO nova.compute.manager [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Attaching volume 79be32d8-4de6-4547-8f6f-d9a9b896a336 to /dev/vdb
Jul 25 10:18:52 user nova-compute[71312]: DEBUG os_brick.utils [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fd33a0-a12f-420e-9590-b7cd207ee254]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de1637e-cef3-4466-aa7f-ee876c87674e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dfa5ed-db41-4da2-ab6a-9686e25b0022]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b51288-06ce-4dcc-a713-1d6fc463122f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:18:52 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:18:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[72efb511-17b3-4d30-8588-850e4fc5bcb8]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG os_brick.utils [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:18:52 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Updating existing volume attachment record: 0cba5f30-70ad-4e38-ade2-c33f89102ec0 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:18:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-ecc018cf-c9e9-43c7-aca9-4183ccbae1a5 req-5b302bc4-5f1b-4b68-830d-e2efadce2ad3 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Received event network-changed-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-ecc018cf-c9e9-43c7-aca9-4183ccbae1a5 req-5b302bc4-5f1b-4b68-830d-e2efadce2ad3 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Refreshing instance network info cache due to event network-changed-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ecc018cf-c9e9-43c7-aca9-4183ccbae1a5 req-5b302bc4-5f1b-4b68-830d-e2efadce2ad3 service nova] Acquiring lock "refresh_cache-126801e6-6953-4d9e-ba02-8c7d00cfcaf1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ecc018cf-c9e9-43c7-aca9-4183ccbae1a5 req-5b302bc4-5f1b-4b68-830d-e2efadce2ad3 service nova] Acquired lock "refresh_cache-126801e6-6953-4d9e-ba02-8c7d00cfcaf1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-ecc018cf-c9e9-43c7-aca9-4183ccbae1a5 req-5b302bc4-5f1b-4b68-830d-e2efadce2ad3 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Refreshing network info cache for port b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lazy-loading 'flavor' on Instance uuid 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:18:56 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Ignoring supplied device name: /dev/vdb
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:18:56 user nova-compute[71312]: INFO nova.compute.manager [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Attaching volume c158c141-6476-4881-99d7-8c05164389a0 to /dev/vdb
Jul 25 10:18:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-ecc018cf-c9e9-43c7-aca9-4183ccbae1a5 req-5b302bc4-5f1b-4b68-830d-e2efadce2ad3 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Updated VIF entry in instance network info cache for port b6fc5b1b-e640-4fa6-b74f-f588474d5fb5. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-ecc018cf-c9e9-43c7-aca9-4183ccbae1a5 req-5b302bc4-5f1b-4b68-830d-e2efadce2ad3 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Updating instance_info_cache with network_info: [{"id": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "address": "fa:16:3e:96:73:47", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fc5b1b-e6", "ovs_interfaceid": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ecc018cf-c9e9-43c7-aca9-4183ccbae1a5 req-5b302bc4-5f1b-4b68-830d-e2efadce2ad3 service nova] Releasing lock "refresh_cache-126801e6-6953-4d9e-ba02-8c7d00cfcaf1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG os_brick.utils [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec5e290-1503-459c-ab1a-5f9779aaa881]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcdb9d8-f661-4c61-99e3-aeffc57edc36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fee0b5-a502-4622-9eb4-131b43ea0fcf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[555efa03-10a1-4435-ab28-528e2503ab3e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:18:56 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:18:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bf8642-b22d-45c2-9199-27260d6348fa]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG os_brick.utils [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:18:56 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Updating existing volume attachment record: 229dac3d-3b0d-43db-876f-d73d02c82b33 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:19:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCtpGvSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:19:03 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:19:03 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:19:03 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[676c883e-596f-4b0f-87d9-3ca88f00d3fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:19:03 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[295b3f0c-07ff-44d4-8306-3de6ce8ab387]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336] added
Jul 25 10:19:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda413a3-14a2-4c8f-a7a5-de5bcff495c2]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5e7a44-48db-4f9c-8764-02312ce692eb]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aCtpGvSi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aCtpGvSi" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aef1958-4e6e-4e41-8f43-2d91e6c916e5]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aCtpGvSi'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d01d60-1308-43dc-90b7-f35c9c8514f0]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c39b3ce-fdff-4865-b3d5-cf596fbd9c3a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:19:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:19:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[530020db-57c4-45b3-9b5a-9e41f00fe18c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336, portal: 172.16.0.220,3260]
Jul 25 10:19:03 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336, portal: 172.16.0.220,3260] successful.
Jul 25 10:19:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcfaef0-a359-44c4-bb8f-131bd776401a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dc85d2-62e7-4403-bf98-f9ad8a92eb62]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:19:03 user nova-compute[71312]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 (non-flash)
Jul 25 10:19:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:19:03 user nova-compute[71312]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 (non-flash)
Jul 25 10:19:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c499b031-1bd1-4274-afba-e08f08e5a865]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:19:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCtpGvSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNGdmRUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:19:04 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26539623933383966', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539623933383966', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.567s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:19:04 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:19:04 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lazy-loading 'flavor' on Instance uuid 7a96ad84-e354-49bf-8234-0edcfa435ae9 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e22fd4-b8aa-482d-a753-4424463e6be7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:19:04 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:19:04 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:19:04 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:19:04 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:19:04 user nova-compute[71312]:   <serial>79be32d8-4de6-4547-8f6f-d9a9b896a336</serial>
Jul 25 10:19:04 user nova-compute[71312]: </disk>
Jul 25 10:19:04 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a346ca8-dbc4-4831-949b-e1a6a7a20290]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0] added
Jul 25 10:19:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd23318-d095-4f9c-b756-5cd837ebb589]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87f4734-238e-4065-a539-89b24173e8a1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNGdmRUQ {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNGdmRUQ" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd0ca4b-94be-421c-a8c6-b1b642642bb5]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wNGdmRUQ'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b780df51-4a18-4bcb-95df-5f2225655513]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ed03b7-08a8-4e76-bfc8-5a31022e2b2e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:19:04 user nova-compute[71312]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 (non-flash)
Jul 25 10:19:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:19:04 user nova-compute[71312]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 (non-flash)
Jul 25 10:19:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[66856263-251b-4fd1-90af-f3f3b53248dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0, portal: 172.16.0.220,3260]
Jul 25 10:19:04 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0, portal: 172.16.0.220,3260] successful.
Jul 25 10:19:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a99b7b-ae89-4b7a-b043-7873a7decd93]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce9dd6d-45f7-40c0-9ab7-bd28c0440935]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:19:04 user nova-compute[71312]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 (non-flash)
Jul 25 10:19:04 user nova-compute[71312]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 (non-flash)
Jul 25 10:19:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:19:04 user nova-compute[71312]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 (non-flash)
Jul 25 10:19:04 user nova-compute[71312]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 (non-flash)
Jul 25 10:19:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c8a4d3-f4ea-430b-9c2d-bcd7015af5b4]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:19:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNGdmRUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:19:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:19:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:19:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] No VIF found with MAC fa:16:3e:95:f9:97, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:19:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2762ce31-8b40-4aa2-9372-fb6bdf4c7a0b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.073s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:19:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] <== connect_volume: return (1879ms) {'type': 'block', 'scsi_wwn': '26133323733316463', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:19:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133323733316463', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:19:05 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lazy-loading 'flavor' on Instance uuid 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:19:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:19:06 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:19:06 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Jul 25 10:19:06 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:19:06 user nova-compute[71312]:   <serial>c158c141-6476-4881-99d7-8c05164389a0</serial>
Jul 25 10:19:06 user nova-compute[71312]: </disk>
Jul 25 10:19:06 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:19:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:19:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:19:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] No VIF found with MAC fa:16:3e:96:73:47, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:19:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f4cf732-b7a2-4251-9189-eb06fe114dc4 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.870s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:07 user nova-compute[71312]: INFO nova.compute.manager [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Detaching volume 79be32d8-4de6-4547-8f6f-d9a9b896a336
Jul 25 10:19:07 user nova-compute[71312]: INFO nova.virt.block_device [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Attempting to driver detach volume 79be32d8-4de6-4547-8f6f-d9a9b896a336 from mountpoint /dev/vdb
Jul 25 10:19:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Attempting to detach device vdb from instance 7a96ad84-e354-49bf-8234-0edcfa435ae9 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:19:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:19:07 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:19:07 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:19:07 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:19:07 user nova-compute[71312]:   <serial>79be32d8-4de6-4547-8f6f-d9a9b896a336</serial>
Jul 25 10:19:07 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:19:07 user nova-compute[71312]: </disk>
Jul 25 10:19:07 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:19:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Successfully detached device vdb from instance 7a96ad84-e354-49bf-8234-0edcfa435ae9 from the persistent domain config.
Jul 25 10:19:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7a96ad84-e354-49bf-8234-0edcfa435ae9 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:19:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:19:07 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:19:07 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:19:07 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:19:07 user nova-compute[71312]:   <serial>79be32d8-4de6-4547-8f6f-d9a9b896a336</serial>
Jul 25 10:19:07 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:19:07 user nova-compute[71312]: </disk>
Jul 25 10:19:07 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:19:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690280347.9707406, 7a96ad84-e354-49bf-8234-0edcfa435ae9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:19:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7a96ad84-e354-49bf-8234-0edcfa435ae9 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:19:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Successfully detached device vdb from instance 7a96ad84-e354-49bf-8234-0edcfa435ae9 from the live domain config.
Jul 25 10:19:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:19:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCtpGvSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:19:07 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:19:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:19:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:19:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfab75b-2855-4ea3-847f-c96e3b5acc90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:19:08 user nova-compute[71312]: No targets found.
Jul 25 10:19:08 user nova-compute[71312]: iSNS:
Jul 25 10:19:08 user nova-compute[71312]: No targets found.
Jul 25 10:19:08 user nova-compute[71312]: STATIC:
Jul 25 10:19:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0
Jul 25 10:19:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:19:08 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:19:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:19:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:19:08 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:19:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336
Jul 25 10:19:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:19:08 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:19:08 user nova-compute[71312]: FIRMWARE:
Jul 25 10:19:08 user nova-compute[71312]: No targets found.
Jul 25 10:19:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:19:08 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:19:08 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7bd4a0-3794-41ca-b26d-1ae8c9b28652]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc7021c-4233-40a2-acaf-ec5c7fbdc3ab]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:19:08 user nova-compute[71312]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 (non-flash)
Jul 25 10:19:08 user nova-compute[71312]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 (non-flash)
Jul 25 10:19:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:19:08 user nova-compute[71312]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 (non-flash)
Jul 25 10:19:08 user nova-compute[71312]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 (non-flash)
Jul 25 10:19:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c976d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4fafab-c265-40b3-840c-207eb42c4b4c]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4875c8e9-24e8-4d32-8239-80eab3e10f3e]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b566e347-7e18-484d-9b65-c26fbaa45dd3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2487bff8-4dea-4629-b2bf-6a58cc331f36]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9569993-95d1-4463-b40a-0703bdef7716]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b23fb8e-6fcc-4a87-8d2b-a9db3ba309e7]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336, portal: 172.16.0.220,3260]
Jul 25 10:19:08 user nova-compute[71312]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336, portal: 172.16.0.220,3260] successful.
Jul 25 10:19:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79be32d8-4de6-4547-8f6f-d9a9b896a336 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d83c0b3-e60e-4704-b2a8-17d71b4ca715]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] <== disconnect_volume: return (289ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:19:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:19:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:19:12 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lazy-loading 'flavor' on Instance uuid 7a96ad84-e354-49bf-8234-0edcfa435ae9 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:19:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9e4b8bbb-0e35-462c-bfa7-644b95b9170b tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.018s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:19 user nova-compute[71312]: INFO nova.compute.manager [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Terminating instance
Jul 25 10:19:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-fd3814a3-f92d-4a44-beda-c379c6f82824 req-b8502043-213b-4cf3-9b86-fe22f8567bbb service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-vif-unplugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fd3814a3-f92d-4a44-beda-c379c6f82824 req-b8502043-213b-4cf3-9b86-fe22f8567bbb service nova] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fd3814a3-f92d-4a44-beda-c379c6f82824 req-b8502043-213b-4cf3-9b86-fe22f8567bbb service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fd3814a3-f92d-4a44-beda-c379c6f82824 req-b8502043-213b-4cf3-9b86-fe22f8567bbb service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-fd3814a3-f92d-4a44-beda-c379c6f82824 req-b8502043-213b-4cf3-9b86-fe22f8567bbb service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] No waiting events found dispatching network-vif-unplugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-fd3814a3-f92d-4a44-beda-c379c6f82824 req-b8502043-213b-4cf3-9b86-fe22f8567bbb service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-vif-unplugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Instance destroyed successfully.
Jul 25 10:19:20 user nova-compute[71312]: DEBUG nova.objects.instance [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'resources' on Instance uuid 8216c52e-c0a7-42b1-9766-7bcffa376b28 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1051551930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1051551930',id=13,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:05:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b14fcd7739f41eabc9e7120f5b58a08',ramdisk_id='',reservation_id='r-nro7mwcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-13369838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:07:20Z,user_data=None,user_id='96d25383d4b6448da2d30479a26bfa0f',uuid=8216c52e-c0a7-42b1-9766-7bcffa376b28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converting VIF {"id": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "address": "fa:16:3e:20:f2:32", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa3349e-fb", "ovs_interfaceid": "3fa3349e-fba2-4bba-a1cb-1ef17e40f35a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=3fa3349e-fba2-4bba-a1cb-1ef17e40f35a,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa3349e-fb') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_vif [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=3fa3349e-fba2-4bba-a1cb-1ef17e40f35a,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa3349e-fb') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fa3349e-fb, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:19:20 user nova-compute[71312]: INFO os_vif [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=3fa3349e-fba2-4bba-a1cb-1ef17e40f35a,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa3349e-fb')
Jul 25 10:19:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLcksZOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:19:20 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e6a7c7-bc35-4f51-bd7d-8690768ddb31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:19:20 user nova-compute[71312]: No targets found.
Jul 25 10:19:20 user nova-compute[71312]: iSNS:
Jul 25 10:19:20 user nova-compute[71312]: No targets found.
Jul 25 10:19:20 user nova-compute[71312]: STATIC:
Jul 25 10:19:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0
Jul 25 10:19:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:19:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:19:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6
Jul 25 10:19:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:19:20 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:19:20 user nova-compute[71312]: FIRMWARE:
Jul 25 10:19:20 user nova-compute[71312]: No targets found.
Jul 25 10:19:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:19:20 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:19:20 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[176e6630-0f0e-49ae-9670-951ef26036fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c21ba9-3f89-4c3d-8141-9a0d454ee7eb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:19:20 user nova-compute[71312]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 (non-flash)
Jul 25 10:19:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 (non-flash)
Jul 25 10:19:20 user nova-compute[71312]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 (non-flash)
Jul 25 10:19:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c02c1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a0d31d-f572-4046-b917-1048d2edf9db]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bebb81-39db-4e7e-9a57-ee0f87e623fa]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[850c0885-fec5-44c6-aa50-02379b5f4f15]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bee617d-d83e-44b3-9f58-27d63f031d3f]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cf1d5c-673f-416b-9104-eef7ddd76644]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ed7d20-0fa9-4343-ab69-c8fa90e0c8c3]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6, portal: 172.16.0.220,3260]
Jul 25 10:19:21 user nova-compute[71312]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6, portal: 172.16.0.220,3260] successful.
Jul 25 10:19:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe867eea-e811-4400-93ea-32e8399134b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[899a2264-8a75-448d-ae1a-b112451b9b0d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:19:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] <== disconnect_volume: return (341ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:19:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:19:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Deleting instance files /opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28_del
Jul 25 10:19:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Deletion of /opt/stack/data/nova/instances/8216c52e-c0a7-42b1-9766-7bcffa376b28_del complete
Jul 25 10:19:21 user nova-compute[71312]: INFO nova.compute.manager [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Took 1.21 seconds to destroy the instance on the hypervisor.
Jul 25 10:19:21 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:19:21 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:19:21 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:19:21 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:19:21 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Took 0.77 seconds to deallocate network for instance.
Jul 25 10:19:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-691ed3ed-d39f-4df0-bba3-5d1ccf612ed6 req-9ccb7b1a-9ecf-450a-aa7e-31fc89d20b0d service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-vif-deleted-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:19:21 user nova-compute[71312]: INFO nova.compute.manager [req-691ed3ed-d39f-4df0-bba3-5d1ccf612ed6 req-9ccb7b1a-9ecf-450a-aa7e-31fc89d20b0d service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Neutron deleted interface 3fa3349e-fba2-4bba-a1cb-1ef17e40f35a; detaching it from the instance and deleting it from the info cache
Jul 25 10:19:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-691ed3ed-d39f-4df0-bba3-5d1ccf612ed6 req-9ccb7b1a-9ecf-450a-aa7e-31fc89d20b0d service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:19:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-691ed3ed-d39f-4df0-bba3-5d1ccf612ed6 req-9ccb7b1a-9ecf-450a-aa7e-31fc89d20b0d service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Detach interface failed, port_id=3fa3349e-fba2-4bba-a1cb-1ef17e40f35a, reason: Instance 8216c52e-c0a7-42b1-9766-7bcffa376b28 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:19:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-80f1b1a1-9f31-4ce9-ae12-fe2019e03ac5 req-192a64e0-8342-4557-9672-93b0f283c4a3 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:19:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80f1b1a1-9f31-4ce9-ae12-fe2019e03ac5 req-192a64e0-8342-4557-9672-93b0f283c4a3 service nova] Acquiring lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80f1b1a1-9f31-4ce9-ae12-fe2019e03ac5 req-192a64e0-8342-4557-9672-93b0f283c4a3 service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80f1b1a1-9f31-4ce9-ae12-fe2019e03ac5 req-192a64e0-8342-4557-9672-93b0f283c4a3 service nova] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-80f1b1a1-9f31-4ce9-ae12-fe2019e03ac5 req-192a64e0-8342-4557-9672-93b0f283c4a3 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] No waiting events found dispatching network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:19:22 user nova-compute[71312]: WARNING nova.compute.manager [req-80f1b1a1-9f31-4ce9-ae12-fe2019e03ac5 req-192a64e0-8342-4557-9672-93b0f283c4a3 service nova] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Received unexpected event network-vif-plugged-3fa3349e-fba2-4bba-a1cb-1ef17e40f35a for instance with vm_state active and task_state deleting.
Jul 25 10:19:22 user nova-compute[71312]: INFO nova.compute.manager [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Took 0.76 seconds to detach 1 volumes for instance.
Jul 25 10:19:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:22 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:19:23 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:19:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:23 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Deleted allocations for instance 8216c52e-c0a7-42b1-9766-7bcffa376b28
Jul 25 10:19:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-74e767a6-fdc9-4924-8437-b3c7442879c7 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "8216c52e-c0a7-42b1-9766-7bcffa376b28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.243s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:19:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:19:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 10:19:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:19:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:19:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:19:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:19:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:19:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:34 user nova-compute[71312]: INFO nova.compute.manager [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Detaching volume c158c141-6476-4881-99d7-8c05164389a0
Jul 25 10:19:34 user nova-compute[71312]: INFO nova.virt.block_device [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Attempting to driver detach volume c158c141-6476-4881-99d7-8c05164389a0 from mountpoint /dev/vdb
Jul 25 10:19:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Attempting to detach device vdb from instance 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:19:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:19:34 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:19:34 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Jul 25 10:19:34 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:19:34 user nova-compute[71312]:   <serial>c158c141-6476-4881-99d7-8c05164389a0</serial>
Jul 25 10:19:34 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:19:34 user nova-compute[71312]: </disk>
Jul 25 10:19:34 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:19:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Successfully detached device vdb from instance 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 from the persistent domain config.
Jul 25 10:19:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:19:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:19:34 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:19:34 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Jul 25 10:19:34 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:19:34 user nova-compute[71312]:   <serial>c158c141-6476-4881-99d7-8c05164389a0</serial>
Jul 25 10:19:34 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:19:34 user nova-compute[71312]: </disk>
Jul 25 10:19:34 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:19:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690280375.302, 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:19:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Successfully detached device vdb from instance 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 from the live domain config.
Jul 25 10:19:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNGdmRUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:19:35 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[51273bfd-3c4f-4e0a-ad1c-80845e4c66b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:19:35 user nova-compute[71312]: No targets found.
Jul 25 10:19:35 user nova-compute[71312]: iSNS:
Jul 25 10:19:35 user nova-compute[71312]: No targets found.
Jul 25 10:19:35 user nova-compute[71312]: STATIC:
Jul 25 10:19:35 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0
Jul 25 10:19:35 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:19:35 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:19:35 user nova-compute[71312]: FIRMWARE:
Jul 25 10:19:35 user nova-compute[71312]: No targets found.
Jul 25 10:19:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:19:35 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:19:35 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b98a769-fe45-44d7-8620-dd600ff98cc3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0bcf0f-61c6-4c3f-bf4b-d2479f88de2d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 (non-flash)
Jul 25 10:19:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 (non-flash)
Jul 25 10:19:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a8620700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8a8a9b-132a-4706-b1f1-ae6a1e08fb44]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccf0833-afe0-4955-9131-5f32a064fc40]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b74bc6-1fd4-4205-bf44-111b3f9da3a8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[184f6798-345f-463c-9ee7-185f43819c3c]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9485ee-8a2b-491a-967b-399e4bdec3bd]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2476094c-b55a-46c1-b58a-4ab81116a073]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0, portal: 172.16.0.220,3260]
Jul 25 10:19:35 user nova-compute[71312]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0, portal: 172.16.0.220,3260] successful.
Jul 25 10:19:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8947775e-7c4e-4217-b4be-20c27d46bb13]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] <== disconnect_volume: return (267ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280360.6782618, 8216c52e-c0a7-42b1-9766-7bcffa376b28 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:19:35 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] VM Stopped (Lifecycle Event)
Jul 25 10:19:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1600ede7-f34d-4c52-a953-b86a1ae2225e None None] [instance: 8216c52e-c0a7-42b1-9766-7bcffa376b28] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG nova.objects.instance [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lazy-loading 'flavor' on Instance uuid 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-22944c17-6fbc-491f-9665-3572db5fff09 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.585s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.442s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:36 user nova-compute[71312]: INFO nova.compute.manager [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Terminating instance
Jul 25 10:19:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-deb8b46a-ea17-4c03-b558-fd415ae31f62 req-8af1f3ab-d557-4b5c-b50f-42ef8d1cc27d service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Received event network-vif-unplugged-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-deb8b46a-ea17-4c03-b558-fd415ae31f62 req-8af1f3ab-d557-4b5c-b50f-42ef8d1cc27d service nova] Acquiring lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-deb8b46a-ea17-4c03-b558-fd415ae31f62 req-8af1f3ab-d557-4b5c-b50f-42ef8d1cc27d service nova] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-deb8b46a-ea17-4c03-b558-fd415ae31f62 req-8af1f3ab-d557-4b5c-b50f-42ef8d1cc27d service nova] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-deb8b46a-ea17-4c03-b558-fd415ae31f62 req-8af1f3ab-d557-4b5c-b50f-42ef8d1cc27d service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] No waiting events found dispatching network-vif-unplugged-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-deb8b46a-ea17-4c03-b558-fd415ae31f62 req-8af1f3ab-d557-4b5c-b50f-42ef8d1cc27d service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Received event network-vif-unplugged-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:19:37 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Instance destroyed successfully.
Jul 25 10:19:37 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lazy-loading 'resources' on Instance uuid 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1016775451',display_name='tempest-VolumesSnapshotTestJSON-instance-1016775451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1016775451',id=35,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEIXPfOe6T2SqZQ1lTsl1ZPJjq3jI9tjHmdNfYMp/6ovVv2UL3ururnCpTMNMzPlzCeqWKmVHCbbmUiyK+K14NaYoz8+VBdP4mKjVMsIPA9kojIbm5NyLMI7Azc2eSZFg==',key_name='tempest-keypair-2135250444',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:17:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef43ca749d7c4576b084ddd6041c4c7f',ramdisk_id='',reservation_id='r-me2z6fdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-458554832',owner_user_name='tempest-VolumesSnapshotTestJSON-458554832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6f0b54327ff42f389ff059e65014340',uuid=126801e6-6953-4d9e-ba02-8c7d00cfcaf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "address": "fa:16:3e:96:73:47", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fc5b1b-e6", "ovs_interfaceid": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Converting VIF {"id": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "address": "fa:16:3e:96:73:47", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fc5b1b-e6", "ovs_interfaceid": "b6fc5b1b-e640-4fa6-b74f-f588474d5fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:73:47,bridge_name='br-int',has_traffic_filtering=True,id=b6fc5b1b-e640-4fa6-b74f-f588474d5fb5,network=Network(e1775143-19d2-4eab-920b-9f631d2248dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6fc5b1b-e6') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG os_vif [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:73:47,bridge_name='br-int',has_traffic_filtering=True,id=b6fc5b1b-e640-4fa6-b74f-f588474d5fb5,network=Network(e1775143-19d2-4eab-920b-9f631d2248dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6fc5b1b-e6') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6fc5b1b-e6, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:19:37 user nova-compute[71312]: INFO os_vif [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:73:47,bridge_name='br-int',has_traffic_filtering=True,id=b6fc5b1b-e640-4fa6-b74f-f588474d5fb5,network=Network(e1775143-19d2-4eab-920b-9f631d2248dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6fc5b1b-e6')
Jul 25 10:19:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:c158c141-6476-4881-99d7-8c05164389a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNGdmRUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:19:37 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:19:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[b349ad4f-540c-4cd8-b5bc-4dab1badd846]: Unexpected error while running command.
Jul 25 10:19:37 user nova-compute[71312]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 25 10:19:37 user nova-compute[71312]: Exit code: 21
Jul 25 10:19:37 user nova-compute[71312]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 25 10:19:37 user nova-compute[71312]: Stderr: '' {{(pid=82549) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Jul 25 10:19:37 user nova-compute[71312]: Traceback (most recent call last):
Jul 25 10:19:37 user nova-compute[71312]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jul 25 10:19:37 user nova-compute[71312]:     ret = func(*f_args, **f_kwargs)
Jul 25 10:19:37 user nova-compute[71312]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jul 25 10:19:37 user nova-compute[71312]:     return func(*args, **kwargs)
Jul 25 10:19:37 user nova-compute[71312]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jul 25 10:19:37 user nova-compute[71312]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jul 25 10:19:37 user nova-compute[71312]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jul 25 10:19:37 user nova-compute[71312]:     return putils.execute(on_execute=on_execute,
Jul 25 10:19:37 user nova-compute[71312]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Jul 25 10:19:37 user nova-compute[71312]:     raise ProcessExecutionError(exit_code=_returncode,
Jul 25 10:19:37 user nova-compute[71312]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 25 10:19:37 user nova-compute[71312]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 25 10:19:37 user nova-compute[71312]: Exit code: 21
Jul 25 10:19:37 user nova-compute[71312]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 25 10:19:37 user nova-compute[71312]: Stderr: ''
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b349ad4f-540c-4cd8-b5bc-4dab1badd846]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 25 10:19:37 user nova-compute[71312]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 25 10:19:37 user nova-compute[71312]: Exit code: 21
Jul 25 10:19:37 user nova-compute[71312]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 25 10:19:37 user nova-compute[71312]: Stderr: ''
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Jul 25 10:19:37 user nova-compute[71312]: ERROR os_brick.initiator.connectors.iscsi 
Jul 25 10:19:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71312) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.033s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] <== disconnect_volume: return (34ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:19:37 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Deleting instance files /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1_del
Jul 25 10:19:37 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Deletion of /opt/stack/data/nova/instances/126801e6-6953-4d9e-ba02-8c7d00cfcaf1_del complete
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:37 user nova-compute[71312]: INFO nova.compute.manager [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:38 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Error from libvirt while getting description of instance-00000023: [Error Code 42] Domain not found: no domain with matching uuid '126801e6-6953-4d9e-ba02-8c7d00cfcaf1' (instance-00000023): libvirt.libvirtError: Domain not found: no domain with matching uuid '126801e6-6953-4d9e-ba02-8c7d00cfcaf1' (instance-00000023)
Jul 25 10:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-2597f2a3-2f02-411d-b9d2-150cc4362905 req-27d22a30-1d3d-4189-9985-f66e7aa06b6d service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Received event network-vif-plugged-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2597f2a3-2f02-411d-b9d2-150cc4362905 req-27d22a30-1d3d-4189-9985-f66e7aa06b6d service nova] Acquiring lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2597f2a3-2f02-411d-b9d2-150cc4362905 req-27d22a30-1d3d-4189-9985-f66e7aa06b6d service nova] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2597f2a3-2f02-411d-b9d2-150cc4362905 req-27d22a30-1d3d-4189-9985-f66e7aa06b6d service nova] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-2597f2a3-2f02-411d-b9d2-150cc4362905 req-27d22a30-1d3d-4189-9985-f66e7aa06b6d service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] No waiting events found dispatching network-vif-plugged-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:19:38 user nova-compute[71312]: WARNING nova.compute.manager [req-2597f2a3-2f02-411d-b9d2-150cc4362905 req-27d22a30-1d3d-4189-9985-f66e7aa06b6d service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Received unexpected event network-vif-plugged-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 for instance with vm_state active and task_state deleting.
Jul 25 10:19:38 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:19:38 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Took 1.45 seconds to deallocate network for instance.
Jul 25 10:19:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-824e6969-5c1a-4beb-b33f-07d53d11c1aa req-02050e28-8b1a-4f67-bb75-e38599acedf8 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Received event network-vif-deleted-b6fc5b1b-e640-4fa6-b74f-f588474d5fb5 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:19:38 user nova-compute[71312]: INFO nova.compute.manager [req-824e6969-5c1a-4beb-b33f-07d53d11c1aa req-02050e28-8b1a-4f67-bb75-e38599acedf8 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Neutron deleted interface b6fc5b1b-e640-4fa6-b74f-f588474d5fb5; detaching it from the instance and deleting it from the info cache
Jul 25 10:19:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-824e6969-5c1a-4beb-b33f-07d53d11c1aa req-02050e28-8b1a-4f67-bb75-e38599acedf8 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-824e6969-5c1a-4beb-b33f-07d53d11c1aa req-02050e28-8b1a-4f67-bb75-e38599acedf8 service nova] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Detach interface failed, port_id=b6fc5b1b-e640-4fa6-b74f-f588474d5fb5, reason: Instance 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:19:38 user nova-compute[71312]: WARNING nova.volume.cinder [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Attachment 229dac3d-3b0d-43db-876f-d73d02c82b33 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 229dac3d-3b0d-43db-876f-d73d02c82b33. (HTTP 404) (Request-ID: req-0926f249-60a3-4bf1-9f73-dcbf98e0ca4e)
Jul 25 10:19:38 user nova-compute[71312]: INFO nova.compute.manager [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Took 0.04 seconds to detach 1 volumes for instance.
Jul 25 10:19:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:19:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:19:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8074MB free_disk=25.13866424560547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.268s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:39 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Deleted allocations for instance 126801e6-6953-4d9e-ba02-8c7d00cfcaf1
Jul 25 10:19:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5823c859-058e-4b2f-91b0-0e4def11bebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f5aa6ae1-551a-4f51-a29f-14612f9b17e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 7a96ad84-e354-49bf-8234-0edcfa435ae9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e9b1831-4d48-46df-ac73-d77554351b59 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "126801e6-6953-4d9e-ba02-8c7d00cfcaf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.253s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:19:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:19:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:19:52 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280377.1286957, 126801e6-6953-4d9e-ba02-8c7d00cfcaf1 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:19:52 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] VM Stopped (Lifecycle Event)
Jul 25 10:19:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0672d65-5dbc-49c0-91e1-28aad6d9b016 None None] [instance: 126801e6-6953-4d9e-ba02-8c7d00cfcaf1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:19:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:56 user nova-compute[71312]: INFO nova.compute.manager [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Rescuing
Jul 25 10:19:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:19:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquired lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:19:56 user nova-compute[71312]: DEBUG nova.network.neutron [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:19:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:19:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Updating instance_info_cache with network_info: [{"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:19:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Releasing lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:19:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-2f01f86d-c754-41a5-8a79-399721c1fc0a req-a6d81981-fffc-4f5c-899d-32467b5fd30c service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received event network-vif-unplugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:19:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2f01f86d-c754-41a5-8a79-399721c1fc0a req-a6d81981-fffc-4f5c-899d-32467b5fd30c service nova] Acquiring lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2f01f86d-c754-41a5-8a79-399721c1fc0a req-a6d81981-fffc-4f5c-899d-32467b5fd30c service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2f01f86d-c754-41a5-8a79-399721c1fc0a req-a6d81981-fffc-4f5c-899d-32467b5fd30c service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-2f01f86d-c754-41a5-8a79-399721c1fc0a req-a6d81981-fffc-4f5c-899d-32467b5fd30c service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] No waiting events found dispatching network-vif-unplugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:19:57 user nova-compute[71312]: WARNING nova.compute.manager [req-2f01f86d-c754-41a5-8a79-399721c1fc0a req-a6d81981-fffc-4f5c-899d-32467b5fd30c service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received unexpected event network-vif-unplugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db for instance with vm_state active and task_state rescuing.
Jul 25 10:19:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:19:58 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Instance destroyed successfully.
Jul 25 10:19:58 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Attempting rescue
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71312) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 10:19:58 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Creating image(s)
Jul 25 10:19:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "/opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "/opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "/opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.objects.instance [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'trusted_certs' on Instance uuid b92c3f88-c9c0-4961-8b53-511c215bed39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue" returned: 0 in 0.056s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.objects.instance [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'migration_context' on Instance uuid b92c3f88-c9c0-4961-8b53-511c215bed39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Start _get_guest_xml network_info=[{"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "vif_mac": "fa:16:3e:01:36:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.objects.instance [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'resources' on Instance uuid b92c3f88-c9c0-4961-8b53-511c215bed39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.objects.instance [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'numa_topology' on Instance uuid b92c3f88-c9c0-4961-8b53-511c215bed39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:19:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:19:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.objects.instance [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'vcpu_model' on Instance uuid b92c3f88-c9c0-4961-8b53-511c215bed39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-408213321',display_name='tempest-ServerRescueNegativeTestJSON-server-408213321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-408213321',id=37,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:18:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce6203d47944c3cb5bca9ab1c173192',ramdisk_id='',reservation_id='r-0osvifav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1328366493',owner_user_name='tempest-ServerRescueNegativeTestJSON-1328366493-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:18:14Z,user_data=None,user_id='fc43767776ce4c9daf58530d543b0e3f',uuid=b92c3f88-c9c0-4961-8b53-511c215bed39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "vif_mac": "fa:16:3e:01:36:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converting VIF {"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "vif_mac": "fa:16:3e:01:36:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:36:c6,bridge_name='br-int',has_traffic_filtering=True,id=6ddfb07b-8e9d-48a1-b8c9-96084b7068db,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddfb07b-8e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.objects.instance [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'pci_devices' on Instance uuid b92c3f88-c9c0-4961-8b53-511c215bed39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:19:58 user nova-compute[71312]:   <uuid>b92c3f88-c9c0-4961-8b53-511c215bed39</uuid>
Jul 25 10:19:58 user nova-compute[71312]:   <name>instance-00000025</name>
Jul 25 10:19:58 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:19:58 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:19:58 user nova-compute[71312]:   <metadata>
Jul 25 10:19:58 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:19:58 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:19:58 user nova-compute[71312]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-408213321</nova:name>
Jul 25 10:19:58 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:19:58</nova:creationTime>
Jul 25 10:19:58 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:19:58 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:19:58 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:19:58 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:19:58 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:19:58 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:19:58 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:19:58 user nova-compute[71312]:       <nova:owner>
Jul 25 10:19:58 user nova-compute[71312]:         <nova:user uuid="fc43767776ce4c9daf58530d543b0e3f">tempest-ServerRescueNegativeTestJSON-1328366493-project-member</nova:user>
Jul 25 10:19:58 user nova-compute[71312]:         <nova:project uuid="3ce6203d47944c3cb5bca9ab1c173192">tempest-ServerRescueNegativeTestJSON-1328366493</nova:project>
Jul 25 10:19:58 user nova-compute[71312]:       </nova:owner>
Jul 25 10:19:58 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:19:58 user nova-compute[71312]:       <nova:ports>
Jul 25 10:19:58 user nova-compute[71312]:         <nova:port uuid="6ddfb07b-8e9d-48a1-b8c9-96084b7068db">
Jul 25 10:19:58 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 10:19:58 user nova-compute[71312]:         </nova:port>
Jul 25 10:19:58 user nova-compute[71312]:       </nova:ports>
Jul 25 10:19:58 user nova-compute[71312]:     </nova:instance>
Jul 25 10:19:58 user nova-compute[71312]:   </metadata>
Jul 25 10:19:58 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:19:58 user nova-compute[71312]:     <system>
Jul 25 10:19:58 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:19:58 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:19:58 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:19:58 user nova-compute[71312]:       <entry name="serial">b92c3f88-c9c0-4961-8b53-511c215bed39</entry>
Jul 25 10:19:58 user nova-compute[71312]:       <entry name="uuid">b92c3f88-c9c0-4961-8b53-511c215bed39</entry>
Jul 25 10:19:58 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:19:58 user nova-compute[71312]:     </system>
Jul 25 10:19:58 user nova-compute[71312]:   </sysinfo>
Jul 25 10:19:58 user nova-compute[71312]:   <os>
Jul 25 10:19:58 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:19:58 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:19:58 user nova-compute[71312]:   </os>
Jul 25 10:19:58 user nova-compute[71312]:   <features>
Jul 25 10:19:58 user nova-compute[71312]:     <acpi/>
Jul 25 10:19:58 user nova-compute[71312]:     <apic/>
Jul 25 10:19:58 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:19:58 user nova-compute[71312]:   </features>
Jul 25 10:19:58 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:19:58 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:19:58 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:19:58 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:19:58 user nova-compute[71312]:   </clock>
Jul 25 10:19:58 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:19:58 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:19:58 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:19:58 user nova-compute[71312]:   </cpu>
Jul 25 10:19:58 user nova-compute[71312]:   <devices>
Jul 25 10:19:58 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:19:58 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:19:58 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue"/>
Jul 25 10:19:58 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:19:58 user nova-compute[71312]:     </disk>
Jul 25 10:19:58 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:19:58 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:19:58 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk"/>
Jul 25 10:19:58 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Jul 25 10:19:58 user nova-compute[71312]:     </disk>
Jul 25 10:19:58 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:19:58 user nova-compute[71312]:       <mac address="fa:16:3e:01:36:c6"/>
Jul 25 10:19:58 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:19:58 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:19:58 user nova-compute[71312]:       <target dev="tap6ddfb07b-8e"/>
Jul 25 10:19:58 user nova-compute[71312]:     </interface>
Jul 25 10:19:58 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:19:58 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/console.log" append="off"/>
Jul 25 10:19:58 user nova-compute[71312]:     </serial>
Jul 25 10:19:58 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:19:58 user nova-compute[71312]:     <video>
Jul 25 10:19:58 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:19:58 user nova-compute[71312]:     </video>
Jul 25 10:19:58 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:19:58 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:19:58 user nova-compute[71312]:     </rng>
Jul 25 10:19:58 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:19:58 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:19:58 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:19:58 user nova-compute[71312]:     </memballoon>
Jul 25 10:19:58 user nova-compute[71312]:   </devices>
Jul 25 10:19:58 user nova-compute[71312]: </domain>
Jul 25 10:19:58 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:19:58 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Instance destroyed successfully.
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:19:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No VIF found with MAC fa:16:3e:01:36:c6, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:19:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-61319a38-7d1c-4d1d-9863-bbef0d5c90c5 req-a085d7fe-3594-4291-a06e-85c64dc740a6 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received event network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:19:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-61319a38-7d1c-4d1d-9863-bbef0d5c90c5 req-a085d7fe-3594-4291-a06e-85c64dc740a6 service nova] Acquiring lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:19:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-61319a38-7d1c-4d1d-9863-bbef0d5c90c5 req-a085d7fe-3594-4291-a06e-85c64dc740a6 service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:19:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-61319a38-7d1c-4d1d-9863-bbef0d5c90c5 req-a085d7fe-3594-4291-a06e-85c64dc740a6 service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:19:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-61319a38-7d1c-4d1d-9863-bbef0d5c90c5 req-a085d7fe-3594-4291-a06e-85c64dc740a6 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] No waiting events found dispatching network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:19:59 user nova-compute[71312]: WARNING nova.compute.manager [req-61319a38-7d1c-4d1d-9863-bbef0d5c90c5 req-a085d7fe-3594-4291-a06e-85c64dc740a6 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received unexpected event network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db for instance with vm_state active and task_state rescuing.
Jul 25 10:20:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa282ea9-1c68-4fbd-9d3e-ed6b88012816 req-f38e0e9b-6d23-4b9f-9d9f-6c576e442de5 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received event network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:20:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa282ea9-1c68-4fbd-9d3e-ed6b88012816 req-f38e0e9b-6d23-4b9f-9d9f-6c576e442de5 service nova] Acquiring lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa282ea9-1c68-4fbd-9d3e-ed6b88012816 req-f38e0e9b-6d23-4b9f-9d9f-6c576e442de5 service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa282ea9-1c68-4fbd-9d3e-ed6b88012816 req-f38e0e9b-6d23-4b9f-9d9f-6c576e442de5 service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa282ea9-1c68-4fbd-9d3e-ed6b88012816 req-f38e0e9b-6d23-4b9f-9d9f-6c576e442de5 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] No waiting events found dispatching network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:20:01 user nova-compute[71312]: WARNING nova.compute.manager [req-fa282ea9-1c68-4fbd-9d3e-ed6b88012816 req-f38e0e9b-6d23-4b9f-9d9f-6c576e442de5 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received unexpected event network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db for instance with vm_state active and task_state rescuing.
Jul 25 10:20:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa282ea9-1c68-4fbd-9d3e-ed6b88012816 req-f38e0e9b-6d23-4b9f-9d9f-6c576e442de5 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received event network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:20:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa282ea9-1c68-4fbd-9d3e-ed6b88012816 req-f38e0e9b-6d23-4b9f-9d9f-6c576e442de5 service nova] Acquiring lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa282ea9-1c68-4fbd-9d3e-ed6b88012816 req-f38e0e9b-6d23-4b9f-9d9f-6c576e442de5 service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa282ea9-1c68-4fbd-9d3e-ed6b88012816 req-f38e0e9b-6d23-4b9f-9d9f-6c576e442de5 service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa282ea9-1c68-4fbd-9d3e-ed6b88012816 req-f38e0e9b-6d23-4b9f-9d9f-6c576e442de5 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] No waiting events found dispatching network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:20:01 user nova-compute[71312]: WARNING nova.compute.manager [req-fa282ea9-1c68-4fbd-9d3e-ed6b88012816 req-f38e0e9b-6d23-4b9f-9d9f-6c576e442de5 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received unexpected event network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db for instance with vm_state active and task_state rescuing.
Jul 25 10:20:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Removed pending event for b92c3f88-c9c0-4961-8b53-511c215bed39 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 10:20:02 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280402.1922514, b92c3f88-c9c0-4961-8b53-511c215bed39 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:20:02 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] VM Resumed (Lifecycle Event)
Jul 25 10:20:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-03421fd7-1a56-4620-ace7-0c2b7fcc39a8 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:20:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:20:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:20:02 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 10:20:02 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280402.1947114, b92c3f88-c9c0-4961-8b53-511c215bed39 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:20:02 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] VM Started (Lifecycle Event)
Jul 25 10:20:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:20:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:03 user nova-compute[71312]: INFO nova.compute.manager [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Terminating instance
Jul 25 10:20:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-33af1879-251a-4a7f-82b4-7d25de13e852 req-be501641-f71f-4217-a27f-da66cc7c3210 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Received event network-vif-unplugged-27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-33af1879-251a-4a7f-82b4-7d25de13e852 req-be501641-f71f-4217-a27f-da66cc7c3210 service nova] Acquiring lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-33af1879-251a-4a7f-82b4-7d25de13e852 req-be501641-f71f-4217-a27f-da66cc7c3210 service nova] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-33af1879-251a-4a7f-82b4-7d25de13e852 req-be501641-f71f-4217-a27f-da66cc7c3210 service nova] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-33af1879-251a-4a7f-82b4-7d25de13e852 req-be501641-f71f-4217-a27f-da66cc7c3210 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] No waiting events found dispatching network-vif-unplugged-27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-33af1879-251a-4a7f-82b4-7d25de13e852 req-be501641-f71f-4217-a27f-da66cc7c3210 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Received event network-vif-unplugged-27d9fdcf-28a9-4c75-9369-d21fcf4313fd for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-33af1879-251a-4a7f-82b4-7d25de13e852 req-be501641-f71f-4217-a27f-da66cc7c3210 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Received event network-vif-plugged-27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-33af1879-251a-4a7f-82b4-7d25de13e852 req-be501641-f71f-4217-a27f-da66cc7c3210 service nova] Acquiring lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-33af1879-251a-4a7f-82b4-7d25de13e852 req-be501641-f71f-4217-a27f-da66cc7c3210 service nova] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-33af1879-251a-4a7f-82b4-7d25de13e852 req-be501641-f71f-4217-a27f-da66cc7c3210 service nova] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-33af1879-251a-4a7f-82b4-7d25de13e852 req-be501641-f71f-4217-a27f-da66cc7c3210 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] No waiting events found dispatching network-vif-plugged-27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:20:03 user nova-compute[71312]: WARNING nova.compute.manager [req-33af1879-251a-4a7f-82b4-7d25de13e852 req-be501641-f71f-4217-a27f-da66cc7c3210 service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Received unexpected event network-vif-plugged-27d9fdcf-28a9-4c75-9369-d21fcf4313fd for instance with vm_state active and task_state deleting.
Jul 25 10:20:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Instance destroyed successfully.
Jul 25 10:20:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lazy-loading 'resources' on Instance uuid 7a96ad84-e354-49bf-8234-0edcfa435ae9 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:20:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-333914761',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-333914761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3339147',id=34,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLdXCPc5AgdLIosQdycWIDsGcra0cfWGZHLmOHNwKt4pl09MnWFc9R4H1sjcyvvF99X0OFlAITUeBzJSaIuob4l1rAmuiRVLbyOi+QGF1IOgmHmU64Gxcd8i1R5r1k4Sg==',key_name='tempest-keypair-1564691037',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b26f355fd1645049dae1f37866d4710',ramdisk_id='',reservation_id='r-b0xh28qt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-503790817',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='558acd016f0d40d6ad4eee118bfa9e42',uuid=7a96ad84-e354-49bf-8234-0edcfa435ae9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "address": "fa:16:3e:95:f9:97", "network": {"id": "37efbc22-d431-443d-84e3-a6438b837541", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-753576595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b26f355fd1645049dae1f37866d4710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d9fdcf-28", "ovs_interfaceid": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:20:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Converting VIF {"id": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "address": "fa:16:3e:95:f9:97", "network": {"id": "37efbc22-d431-443d-84e3-a6438b837541", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-753576595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b26f355fd1645049dae1f37866d4710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d9fdcf-28", "ovs_interfaceid": "27d9fdcf-28a9-4c75-9369-d21fcf4313fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:20:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=27d9fdcf-28a9-4c75-9369-d21fcf4313fd,network=Network(37efbc22-d431-443d-84e3-a6438b837541),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d9fdcf-28') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:20:04 user nova-compute[71312]: DEBUG os_vif [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=27d9fdcf-28a9-4c75-9369-d21fcf4313fd,network=Network(37efbc22-d431-443d-84e3-a6438b837541),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d9fdcf-28') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:20:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27d9fdcf-28, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:20:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:20:04 user nova-compute[71312]: INFO os_vif [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=27d9fdcf-28a9-4c75-9369-d21fcf4313fd,network=Network(37efbc22-d431-443d-84e3-a6438b837541),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d9fdcf-28')
Jul 25 10:20:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Deleting instance files /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9_del
Jul 25 10:20:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Deletion of /opt/stack/data/nova/instances/7a96ad84-e354-49bf-8234-0edcfa435ae9_del complete
Jul 25 10:20:04 user nova-compute[71312]: INFO nova.compute.manager [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 25 10:20:04 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:20:04 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:20:04 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:20:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:05 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:20:05 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Took 1.22 seconds to deallocate network for instance.
Jul 25 10:20:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-5ca19cb1-fafd-4190-965a-2aaba99c707d req-5b5e51b5-dc06-4241-83cb-e9de79d3948f service nova] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Received event network-vif-deleted-27d9fdcf-28a9-4c75-9369-d21fcf4313fd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:20:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:20:05 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:20:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:05 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Deleted allocations for instance 7a96ad84-e354-49bf-8234-0edcfa435ae9
Jul 25 10:20:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-243581b1-6698-4ca8-9a5e-b3ec81d5d9bc tempest-TestServerVolumeAttachScenarioOldVersion-503790817 tempest-TestServerVolumeAttachScenarioOldVersion-503790817-project-member] Lock "7a96ad84-e354-49bf-8234-0edcfa435ae9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.598s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "5823c859-058e-4b2f-91b0-0e4def11bebf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:10 user nova-compute[71312]: INFO nova.compute.manager [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Terminating instance
Jul 25 10:20:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:20:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-4dc5cb18-e9fe-48d7-a672-e4f945fd7898 req-9c23d8bd-b93e-408b-b9de-798159600c46 service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Received event network-vif-unplugged-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4dc5cb18-e9fe-48d7-a672-e4f945fd7898 req-9c23d8bd-b93e-408b-b9de-798159600c46 service nova] Acquiring lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4dc5cb18-e9fe-48d7-a672-e4f945fd7898 req-9c23d8bd-b93e-408b-b9de-798159600c46 service nova] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4dc5cb18-e9fe-48d7-a672-e4f945fd7898 req-9c23d8bd-b93e-408b-b9de-798159600c46 service nova] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-4dc5cb18-e9fe-48d7-a672-e4f945fd7898 req-9c23d8bd-b93e-408b-b9de-798159600c46 service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] No waiting events found dispatching network-vif-unplugged-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-4dc5cb18-e9fe-48d7-a672-e4f945fd7898 req-9c23d8bd-b93e-408b-b9de-798159600c46 service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Received event network-vif-unplugged-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Instance destroyed successfully.
Jul 25 10:20:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lazy-loading 'resources' on Instance uuid 5823c859-058e-4b2f-91b0-0e4def11bebf {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-724910394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-724910394',id=3,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:00:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b14fcd7739f41eabc9e7120f5b58a08',ramdisk_id='',reservation_id='r-fzulogf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-13369838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:02:28Z,user_data=None,user_id='96d25383d4b6448da2d30479a26bfa0f',uuid=5823c859-058e-4b2f-91b0-0e4def11bebf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "address": "fa:16:3e:60:b3:44", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d07c46c-fb", "ovs_interfaceid": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converting VIF {"id": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "address": "fa:16:3e:60:b3:44", "network": {"id": "88346482-79b3-4253-af8f-c22ac38d9023", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-933801172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b14fcd7739f41eabc9e7120f5b58a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d07c46c-fb", "ovs_interfaceid": "6d07c46c-fbbc-4e54-9261-0cd213bbb4ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:b3:44,bridge_name='br-int',has_traffic_filtering=True,id=6d07c46c-fbbc-4e54-9261-0cd213bbb4ca,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d07c46c-fb') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG os_vif [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:b3:44,bridge_name='br-int',has_traffic_filtering=True,id=6d07c46c-fbbc-4e54-9261-0cd213bbb4ca,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d07c46c-fb') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d07c46c-fb, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:20:11 user nova-compute[71312]: INFO os_vif [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:b3:44,bridge_name='br-int',has_traffic_filtering=True,id=6d07c46c-fbbc-4e54-9261-0cd213bbb4ca,network=Network(88346482-79b3-4253-af8f-c22ac38d9023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d07c46c-fb')
Jul 25 10:20:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Deleting instance files /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf_del
Jul 25 10:20:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Deletion of /opt/stack/data/nova/instances/5823c859-058e-4b2f-91b0-0e4def11bebf_del complete
Jul 25 10:20:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:11 user nova-compute[71312]: INFO nova.compute.manager [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Took 0.72 seconds to destroy the instance on the hypervisor.
Jul 25 10:20:11 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:20:11 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Took 0.47 seconds to deallocate network for instance.
Jul 25 10:20:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:12 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:20:12 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:20:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:12 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Deleted allocations for instance 5823c859-058e-4b2f-91b0-0e4def11bebf
Jul 25 10:20:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-675451b9-ef75-4359-bc4e-108a7d110ac2 tempest-ServerBootFromVolumeStableRescueTest-13369838 tempest-ServerBootFromVolumeStableRescueTest-13369838-project-member] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.544s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-8e5cb31e-c86e-43f2-a5bc-2f8b179ea566 req-80bcbc91-badf-4084-87bb-d2e257e5bed0 service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Received event network-vif-plugged-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:20:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8e5cb31e-c86e-43f2-a5bc-2f8b179ea566 req-80bcbc91-badf-4084-87bb-d2e257e5bed0 service nova] Acquiring lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8e5cb31e-c86e-43f2-a5bc-2f8b179ea566 req-80bcbc91-badf-4084-87bb-d2e257e5bed0 service nova] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8e5cb31e-c86e-43f2-a5bc-2f8b179ea566 req-80bcbc91-badf-4084-87bb-d2e257e5bed0 service nova] Lock "5823c859-058e-4b2f-91b0-0e4def11bebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-8e5cb31e-c86e-43f2-a5bc-2f8b179ea566 req-80bcbc91-badf-4084-87bb-d2e257e5bed0 service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] No waiting events found dispatching network-vif-plugged-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:20:13 user nova-compute[71312]: WARNING nova.compute.manager [req-8e5cb31e-c86e-43f2-a5bc-2f8b179ea566 req-80bcbc91-badf-4084-87bb-d2e257e5bed0 service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Received unexpected event network-vif-plugged-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca for instance with vm_state deleted and task_state None.
Jul 25 10:20:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-8e5cb31e-c86e-43f2-a5bc-2f8b179ea566 req-80bcbc91-badf-4084-87bb-d2e257e5bed0 service nova] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Received event network-vif-deleted-6d07c46c-fbbc-4e54-9261-0cd213bbb4ca {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:20:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:19 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280403.9988592, 7a96ad84-e354-49bf-8234-0edcfa435ae9 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:20:19 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] VM Stopped (Lifecycle Event)
Jul 25 10:20:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9b761531-6919-45c7-97a5-283b47d275d1 None None] [instance: 7a96ad84-e354-49bf-8234-0edcfa435ae9] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:20:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:26 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280411.273323, 5823c859-058e-4b2f-91b0-0e4def11bebf => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:20:26 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] VM Stopped (Lifecycle Event)
Jul 25 10:20:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6efb256d-2da5-4af5-b422-7654ca0d1fb9 None None] [instance: 5823c859-058e-4b2f-91b0-0e4def11bebf] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:20:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:20:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:20:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 10:20:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-f5aa6ae1-551a-4f51-a29f-14612f9b17e6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:20:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-f5aa6ae1-551a-4f51-a29f-14612f9b17e6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:20:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:20:28 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lazy-loading 'info_cache' on Instance uuid f5aa6ae1-551a-4f51-a29f-14612f9b17e6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:20:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Updating instance_info_cache with network_info: [{"id": "c26e10b5-2f15-45c8-9745-5556b19709a7", "address": "fa:16:3e:e3:1b:7d", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26e10b5-2f", "ovs_interfaceid": "c26e10b5-2f15-45c8-9745-5556b19709a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-f5aa6ae1-551a-4f51-a29f-14612f9b17e6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:20:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:20:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:20:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:20:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:20:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:33 user nova-compute[71312]: INFO nova.compute.manager [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Terminating instance
Jul 25 10:20:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-f3922da4-c329-4353-b068-02bcd0bff693 req-4dd46f45-8ac7-4926-a0f8-4ed40b49c839 service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Received event network-vif-unplugged-c26e10b5-2f15-45c8-9745-5556b19709a7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3922da4-c329-4353-b068-02bcd0bff693 req-4dd46f45-8ac7-4926-a0f8-4ed40b49c839 service nova] Acquiring lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3922da4-c329-4353-b068-02bcd0bff693 req-4dd46f45-8ac7-4926-a0f8-4ed40b49c839 service nova] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3922da4-c329-4353-b068-02bcd0bff693 req-4dd46f45-8ac7-4926-a0f8-4ed40b49c839 service nova] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-f3922da4-c329-4353-b068-02bcd0bff693 req-4dd46f45-8ac7-4926-a0f8-4ed40b49c839 service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] No waiting events found dispatching network-vif-unplugged-c26e10b5-2f15-45c8-9745-5556b19709a7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-f3922da4-c329-4353-b068-02bcd0bff693 req-4dd46f45-8ac7-4926-a0f8-4ed40b49c839 service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Received event network-vif-unplugged-c26e10b5-2f15-45c8-9745-5556b19709a7 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:20:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:20:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Instance destroyed successfully.
Jul 25 10:20:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lazy-loading 'resources' on Instance uuid f5aa6ae1-551a-4f51-a29f-14612f9b17e6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:20:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:11:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2012189606',display_name='tempest-ServersNegativeTestJSON-server-2012189606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2012189606',id=27,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:11:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e2222bf62bf487c911c811dbd8df8f1',ramdisk_id='',reservation_id='r-5w31bnk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-404227801',owner_user_name='tempest-ServersNegativeTestJSON-404227801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:11:49Z,user_data=None,user_id='3597b22f53c54e5ab63730caefea2369',uuid=f5aa6ae1-551a-4f51-a29f-14612f9b17e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c26e10b5-2f15-45c8-9745-5556b19709a7", "address": "fa:16:3e:e3:1b:7d", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26e10b5-2f", "ovs_interfaceid": "c26e10b5-2f15-45c8-9745-5556b19709a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:20:34 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Converting VIF {"id": "c26e10b5-2f15-45c8-9745-5556b19709a7", "address": "fa:16:3e:e3:1b:7d", "network": {"id": "44edfeb7-92a1-4284-ae77-c7d1e351aa07", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1934759214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e2222bf62bf487c911c811dbd8df8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26e10b5-2f", "ovs_interfaceid": "c26e10b5-2f15-45c8-9745-5556b19709a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:20:34 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:1b:7d,bridge_name='br-int',has_traffic_filtering=True,id=c26e10b5-2f15-45c8-9745-5556b19709a7,network=Network(44edfeb7-92a1-4284-ae77-c7d1e351aa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26e10b5-2f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:20:34 user nova-compute[71312]: DEBUG os_vif [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:1b:7d,bridge_name='br-int',has_traffic_filtering=True,id=c26e10b5-2f15-45c8-9745-5556b19709a7,network=Network(44edfeb7-92a1-4284-ae77-c7d1e351aa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26e10b5-2f') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:20:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc26e10b5-2f, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:20:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:20:34 user nova-compute[71312]: INFO os_vif [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:1b:7d,bridge_name='br-int',has_traffic_filtering=True,id=c26e10b5-2f15-45c8-9745-5556b19709a7,network=Network(44edfeb7-92a1-4284-ae77-c7d1e351aa07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26e10b5-2f')
Jul 25 10:20:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Deleting instance files /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6_del
Jul 25 10:20:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Deletion of /opt/stack/data/nova/instances/f5aa6ae1-551a-4f51-a29f-14612f9b17e6_del complete
Jul 25 10:20:34 user nova-compute[71312]: INFO nova.compute.manager [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 25 10:20:34 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:20:34 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:20:34 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:20:34 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:20:35 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Took 0.56 seconds to deallocate network for instance.
Jul 25 10:20:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-d7438f28-c8d8-4305-8c0f-08df132fc94a req-a8d4f4d4-0ff4-470b-87d4-1c6d0679f294 service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Received event network-vif-deleted-c26e10b5-2f15-45c8-9745-5556b19709a7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:20:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:35 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:20:35 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:35 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Deleted allocations for instance f5aa6ae1-551a-4f51-a29f-14612f9b17e6
Jul 25 10:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-354b0448-4d03-469d-93eb-a5af4b5d08cc tempest-ServersNegativeTestJSON-404227801 tempest-ServersNegativeTestJSON-404227801-project-member] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.870s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-04e6a9c0-f633-4630-81d5-fdcdac54eb36 req-e83bcfca-6426-4f49-be6e-0f63615840ae service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Received event network-vif-plugged-c26e10b5-2f15-45c8-9745-5556b19709a7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04e6a9c0-f633-4630-81d5-fdcdac54eb36 req-e83bcfca-6426-4f49-be6e-0f63615840ae service nova] Acquiring lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04e6a9c0-f633-4630-81d5-fdcdac54eb36 req-e83bcfca-6426-4f49-be6e-0f63615840ae service nova] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04e6a9c0-f633-4630-81d5-fdcdac54eb36 req-e83bcfca-6426-4f49-be6e-0f63615840ae service nova] Lock "f5aa6ae1-551a-4f51-a29f-14612f9b17e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-04e6a9c0-f633-4630-81d5-fdcdac54eb36 req-e83bcfca-6426-4f49-be6e-0f63615840ae service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] No waiting events found dispatching network-vif-plugged-c26e10b5-2f15-45c8-9745-5556b19709a7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:20:35 user nova-compute[71312]: WARNING nova.compute.manager [req-04e6a9c0-f633-4630-81d5-fdcdac54eb36 req-e83bcfca-6426-4f49-be6e-0f63615840ae service nova] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Received unexpected event network-vif-plugged-c26e10b5-2f15-45c8-9745-5556b19709a7 for instance with vm_state deleted and task_state None.
Jul 25 10:20:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:20:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:20:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:20:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:20:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:20:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:20:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:20:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:20:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:20:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:20:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:20:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:20:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:20:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:20:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:20:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:20:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:20:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8425MB free_disk=25.33547592163086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:20:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:20:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:20:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:20:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:20:39 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:20:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:20:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:20:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:20:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:20:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:20:46 user nova-compute[71312]: INFO nova.compute.claims [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Claim successful on node user
Jul 25 10:20:46 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:20:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:20:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG nova.policy [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6f0b54327ff42f389ff059e65014340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef43ca749d7c4576b084ddd6041c4c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:20:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Creating image(s)
Jul 25 10:20:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "/opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "/opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "/opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk 1073741824" returned: 0 in 0.060s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Cannot resize image /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lazy-loading 'migration_context' on Instance uuid 6471ba37-ab4e-4610-927e-ba5639b0fc91 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Ensure instance console log exists: /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Successfully created port: 7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Successfully updated port: 7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "refresh_cache-6471ba37-ab4e-4610-927e-ba5639b0fc91" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquired lock "refresh_cache-6471ba37-ab4e-4610-927e-ba5639b0fc91" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-8faf786a-4e92-40f4-add4-1c0a65bbddd2 req-9250b3ed-e69c-4ccb-951e-0c14df832ba6 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Received event network-changed-7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-8faf786a-4e92-40f4-add4-1c0a65bbddd2 req-9250b3ed-e69c-4ccb-951e-0c14df832ba6 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Refreshing instance network info cache due to event network-changed-7ddc7200-6a27-491b-834b-101bb1e0b1ba. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8faf786a-4e92-40f4-add4-1c0a65bbddd2 req-9250b3ed-e69c-4ccb-951e-0c14df832ba6 service nova] Acquiring lock "refresh_cache-6471ba37-ab4e-4610-927e-ba5639b0fc91" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Updating instance_info_cache with network_info: [{"id": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "address": "fa:16:3e:42:7e:64", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddc7200-6a", "ovs_interfaceid": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Releasing lock "refresh_cache-6471ba37-ab4e-4610-927e-ba5639b0fc91" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Instance network_info: |[{"id": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "address": "fa:16:3e:42:7e:64", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddc7200-6a", "ovs_interfaceid": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8faf786a-4e92-40f4-add4-1c0a65bbddd2 req-9250b3ed-e69c-4ccb-951e-0c14df832ba6 service nova] Acquired lock "refresh_cache-6471ba37-ab4e-4610-927e-ba5639b0fc91" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.network.neutron [req-8faf786a-4e92-40f4-add4-1c0a65bbddd2 req-9250b3ed-e69c-4ccb-951e-0c14df832ba6 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Refreshing network info cache for port 7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Start _get_guest_xml network_info=[{"id": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "address": "fa:16:3e:42:7e:64", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddc7200-6a", "ovs_interfaceid": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:20:48 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:20:48 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1502911764',display_name='tempest-VolumesSnapshotTestJSON-instance-1502911764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1502911764',id=38,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7DvQGMCqexutAdVzSCK7lDyErYDNxgw3ARHtF4ahmxNtasTtZJqROZRwykJ5t8uHOnUMpGSuXEN/9/eGfffkX+mNiEDQzBEavPOPMrngQp8RR1fIWewyfkU9E2ZmjG+g==',key_name='tempest-keypair-537319045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef43ca749d7c4576b084ddd6041c4c7f',ramdisk_id='',reservation_id='r-fw4fisb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-458554832',owner_user_name='tempest-VolumesSnapshotTestJSON-458554832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:20:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6f0b54327ff42f389ff059e65014340',uuid=6471ba37-ab4e-4610-927e-ba5639b0fc91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "address": "fa:16:3e:42:7e:64", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddc7200-6a", "ovs_interfaceid": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Converting VIF {"id": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "address": "fa:16:3e:42:7e:64", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddc7200-6a", "ovs_interfaceid": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:64,bridge_name='br-int',has_traffic_filtering=True,id=7ddc7200-6a27-491b-834b-101bb1e0b1ba,network=Network(e1775143-19d2-4eab-920b-9f631d2248dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ddc7200-6a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lazy-loading 'pci_devices' on Instance uuid 6471ba37-ab4e-4610-927e-ba5639b0fc91 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:20:48 user nova-compute[71312]:   <uuid>6471ba37-ab4e-4610-927e-ba5639b0fc91</uuid>
Jul 25 10:20:48 user nova-compute[71312]:   <name>instance-00000026</name>
Jul 25 10:20:48 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:20:48 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:20:48 user nova-compute[71312]:   <metadata>
Jul 25 10:20:48 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:20:48 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:20:48 user nova-compute[71312]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1502911764</nova:name>
Jul 25 10:20:48 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:20:48</nova:creationTime>
Jul 25 10:20:48 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:20:48 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:20:48 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:20:48 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:20:48 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:20:48 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:20:48 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:20:48 user nova-compute[71312]:       <nova:owner>
Jul 25 10:20:48 user nova-compute[71312]:         <nova:user uuid="e6f0b54327ff42f389ff059e65014340">tempest-VolumesSnapshotTestJSON-458554832-project-member</nova:user>
Jul 25 10:20:48 user nova-compute[71312]:         <nova:project uuid="ef43ca749d7c4576b084ddd6041c4c7f">tempest-VolumesSnapshotTestJSON-458554832</nova:project>
Jul 25 10:20:48 user nova-compute[71312]:       </nova:owner>
Jul 25 10:20:48 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:20:48 user nova-compute[71312]:       <nova:ports>
Jul 25 10:20:48 user nova-compute[71312]:         <nova:port uuid="7ddc7200-6a27-491b-834b-101bb1e0b1ba">
Jul 25 10:20:48 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:20:48 user nova-compute[71312]:         </nova:port>
Jul 25 10:20:48 user nova-compute[71312]:       </nova:ports>
Jul 25 10:20:48 user nova-compute[71312]:     </nova:instance>
Jul 25 10:20:48 user nova-compute[71312]:   </metadata>
Jul 25 10:20:48 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:20:48 user nova-compute[71312]:     <system>
Jul 25 10:20:48 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:20:48 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:20:48 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:20:48 user nova-compute[71312]:       <entry name="serial">6471ba37-ab4e-4610-927e-ba5639b0fc91</entry>
Jul 25 10:20:48 user nova-compute[71312]:       <entry name="uuid">6471ba37-ab4e-4610-927e-ba5639b0fc91</entry>
Jul 25 10:20:48 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:20:48 user nova-compute[71312]:     </system>
Jul 25 10:20:48 user nova-compute[71312]:   </sysinfo>
Jul 25 10:20:48 user nova-compute[71312]:   <os>
Jul 25 10:20:48 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:20:48 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:20:48 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:20:48 user nova-compute[71312]:   </os>
Jul 25 10:20:48 user nova-compute[71312]:   <features>
Jul 25 10:20:48 user nova-compute[71312]:     <acpi/>
Jul 25 10:20:48 user nova-compute[71312]:     <apic/>
Jul 25 10:20:48 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:20:48 user nova-compute[71312]:   </features>
Jul 25 10:20:48 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:20:48 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:20:48 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:20:48 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:20:48 user nova-compute[71312]:   </clock>
Jul 25 10:20:48 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:20:48 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:20:48 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:20:48 user nova-compute[71312]:   </cpu>
Jul 25 10:20:48 user nova-compute[71312]:   <devices>
Jul 25 10:20:48 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:20:48 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:20:48 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk"/>
Jul 25 10:20:48 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:20:48 user nova-compute[71312]:     </disk>
Jul 25 10:20:48 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:20:48 user nova-compute[71312]:       <mac address="fa:16:3e:42:7e:64"/>
Jul 25 10:20:48 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:20:48 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:20:48 user nova-compute[71312]:       <target dev="tap7ddc7200-6a"/>
Jul 25 10:20:48 user nova-compute[71312]:     </interface>
Jul 25 10:20:48 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:20:48 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/console.log" append="off"/>
Jul 25 10:20:48 user nova-compute[71312]:     </serial>
Jul 25 10:20:48 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:20:48 user nova-compute[71312]:     <video>
Jul 25 10:20:48 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:20:48 user nova-compute[71312]:     </video>
Jul 25 10:20:48 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:20:48 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:20:48 user nova-compute[71312]:     </rng>
Jul 25 10:20:48 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:20:48 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:20:48 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:20:48 user nova-compute[71312]:     </memballoon>
Jul 25 10:20:48 user nova-compute[71312]:   </devices>
Jul 25 10:20:48 user nova-compute[71312]: </domain>
Jul 25 10:20:48 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1502911764',display_name='tempest-VolumesSnapshotTestJSON-instance-1502911764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1502911764',id=38,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7DvQGMCqexutAdVzSCK7lDyErYDNxgw3ARHtF4ahmxNtasTtZJqROZRwykJ5t8uHOnUMpGSuXEN/9/eGfffkX+mNiEDQzBEavPOPMrngQp8RR1fIWewyfkU9E2ZmjG+g==',key_name='tempest-keypair-537319045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef43ca749d7c4576b084ddd6041c4c7f',ramdisk_id='',reservation_id='r-fw4fisb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-458554832',owner_user_name='tempest-VolumesSnapshotTestJSON-458554832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:20:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6f0b54327ff42f389ff059e65014340',uuid=6471ba37-ab4e-4610-927e-ba5639b0fc91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "address": "fa:16:3e:42:7e:64", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddc7200-6a", "ovs_interfaceid": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Converting VIF {"id": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "address": "fa:16:3e:42:7e:64", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddc7200-6a", "ovs_interfaceid": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:64,bridge_name='br-int',has_traffic_filtering=True,id=7ddc7200-6a27-491b-834b-101bb1e0b1ba,network=Network(e1775143-19d2-4eab-920b-9f631d2248dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ddc7200-6a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG os_vif [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:64,bridge_name='br-int',has_traffic_filtering=True,id=7ddc7200-6a27-491b-834b-101bb1e0b1ba,network=Network(e1775143-19d2-4eab-920b-9f631d2248dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ddc7200-6a') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ddc7200-6a, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ddc7200-6a, col_values=(('external_ids', {'iface-id': '7ddc7200-6a27-491b-834b-101bb1e0b1ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:7e:64', 'vm-uuid': '6471ba37-ab4e-4610-927e-ba5639b0fc91'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:20:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:48 user nova-compute[71312]: INFO os_vif [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:64,bridge_name='br-int',has_traffic_filtering=True,id=7ddc7200-6a27-491b-834b-101bb1e0b1ba,network=Network(e1775143-19d2-4eab-920b-9f631d2248dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ddc7200-6a')
Jul 25 10:20:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:20:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] No VIF found with MAC fa:16:3e:42:7e:64, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:20:49 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280434.1682913, f5aa6ae1-551a-4f51-a29f-14612f9b17e6 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:20:49 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] VM Stopped (Lifecycle Event)
Jul 25 10:20:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-da0e060d-0069-40a9-9981-ef5101c320a7 None None] [instance: f5aa6ae1-551a-4f51-a29f-14612f9b17e6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:20:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-8faf786a-4e92-40f4-add4-1c0a65bbddd2 req-9250b3ed-e69c-4ccb-951e-0c14df832ba6 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Updated VIF entry in instance network info cache for port 7ddc7200-6a27-491b-834b-101bb1e0b1ba. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:20:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-8faf786a-4e92-40f4-add4-1c0a65bbddd2 req-9250b3ed-e69c-4ccb-951e-0c14df832ba6 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Updating instance_info_cache with network_info: [{"id": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "address": "fa:16:3e:42:7e:64", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddc7200-6a", "ovs_interfaceid": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:20:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8faf786a-4e92-40f4-add4-1c0a65bbddd2 req-9250b3ed-e69c-4ccb-951e-0c14df832ba6 service nova] Releasing lock "refresh_cache-6471ba37-ab4e-4610-927e-ba5639b0fc91" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:20:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-18f008f6-51da-44f5-932e-2309c267be34 req-e3695eae-8f1f-4b85-a7ae-49fe13dd9797 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Received event network-vif-plugged-7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:20:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18f008f6-51da-44f5-932e-2309c267be34 req-e3695eae-8f1f-4b85-a7ae-49fe13dd9797 service nova] Acquiring lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18f008f6-51da-44f5-932e-2309c267be34 req-e3695eae-8f1f-4b85-a7ae-49fe13dd9797 service nova] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18f008f6-51da-44f5-932e-2309c267be34 req-e3695eae-8f1f-4b85-a7ae-49fe13dd9797 service nova] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-18f008f6-51da-44f5-932e-2309c267be34 req-e3695eae-8f1f-4b85-a7ae-49fe13dd9797 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] No waiting events found dispatching network-vif-plugged-7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:20:50 user nova-compute[71312]: WARNING nova.compute.manager [req-18f008f6-51da-44f5-932e-2309c267be34 req-e3695eae-8f1f-4b85-a7ae-49fe13dd9797 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Received unexpected event network-vif-plugged-7ddc7200-6a27-491b-834b-101bb1e0b1ba for instance with vm_state building and task_state spawning.
Jul 25 10:20:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280452.4251668, 6471ba37-ab4e-4610-927e-ba5639b0fc91 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:20:52 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] VM Resumed (Lifecycle Event)
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:20:52 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Instance spawned successfully.
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:20:52 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280452.4265845, 6471ba37-ab4e-4610-927e-ba5639b0fc91 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:20:52 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] VM Started (Lifecycle Event)
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:20:52 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:20:52 user nova-compute[71312]: INFO nova.compute.manager [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Took 5.61 seconds to spawn the instance on the hypervisor.
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:20:52 user nova-compute[71312]: INFO nova.compute.manager [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Took 6.21 seconds to build instance.
Jul 25 10:20:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1dcdff6-8196-4e77-947d-c6c702639fb3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.305s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-27b04e70-fa86-4999-8337-f26710b421b9 req-ad06a072-9861-450f-acc8-335afb0b3b15 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Received event network-vif-plugged-7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-27b04e70-fa86-4999-8337-f26710b421b9 req-ad06a072-9861-450f-acc8-335afb0b3b15 service nova] Acquiring lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-27b04e70-fa86-4999-8337-f26710b421b9 req-ad06a072-9861-450f-acc8-335afb0b3b15 service nova] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-27b04e70-fa86-4999-8337-f26710b421b9 req-ad06a072-9861-450f-acc8-335afb0b3b15 service nova] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:20:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-27b04e70-fa86-4999-8337-f26710b421b9 req-ad06a072-9861-450f-acc8-335afb0b3b15 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] No waiting events found dispatching network-vif-plugged-7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:20:52 user nova-compute[71312]: WARNING nova.compute.manager [req-27b04e70-fa86-4999-8337-f26710b421b9 req-ad06a072-9861-450f-acc8-335afb0b3b15 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Received unexpected event network-vif-plugged-7ddc7200-6a27-491b-834b-101bb1e0b1ba for instance with vm_state active and task_state None.
Jul 25 10:20:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:20:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "f7858973-7146-4229-9f41-00ebcc7618b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "f7858973-7146-4229-9f41-00ebcc7618b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:21:21 user nova-compute[71312]: INFO nova.compute.claims [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Claim successful on node user
Jul 25 10:21:21 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:21:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:21:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:21:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Creating image(s)
Jul 25 10:21:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "/opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "/opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:21:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG nova.policy [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cca4cdd12f543a2a5864f8a36f56cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfc3cefb0ef4063b439dcbd676372de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.165s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.198s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk 1073741824" returned: 0 in 0.090s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Cannot resize image /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lazy-loading 'migration_context' on Instance uuid f7858973-7146-4229-9f41-00ebcc7618b4 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Ensure instance console log exists: /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:21:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Successfully created port: 1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:21:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Successfully updated port: 1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquired lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-730155d8-ba6e-4e53-a2d5-ffc9b925253f req-50ea4cec-cc2f-46b8-9eb5-275e50360b4e service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Received event network-changed-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-730155d8-ba6e-4e53-a2d5-ffc9b925253f req-50ea4cec-cc2f-46b8-9eb5-275e50360b4e service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Refreshing instance network info cache due to event network-changed-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-730155d8-ba6e-4e53-a2d5-ffc9b925253f req-50ea4cec-cc2f-46b8-9eb5-275e50360b4e service nova] Acquiring lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Updating instance_info_cache with network_info: [{"id": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "address": "fa:16:3e:54:ae:25", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0efcfa-7e", "ovs_interfaceid": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Releasing lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Instance network_info: |[{"id": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "address": "fa:16:3e:54:ae:25", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0efcfa-7e", "ovs_interfaceid": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-730155d8-ba6e-4e53-a2d5-ffc9b925253f req-50ea4cec-cc2f-46b8-9eb5-275e50360b4e service nova] Acquired lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.network.neutron [req-730155d8-ba6e-4e53-a2d5-ffc9b925253f req-50ea4cec-cc2f-46b8-9eb5-275e50360b4e service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Refreshing network info cache for port 1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Start _get_guest_xml network_info=[{"id": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "address": "fa:16:3e:54:ae:25", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0efcfa-7e", "ovs_interfaceid": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:21:24 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:21:24 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1391802317',display_name='tempest-TestStampPattern-server-1391802317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1391802317',id=39,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO1P3w5txB81eBV0yGtov3Oc4MCOl8jqxiKKGPa9B1SJkwnNnhcpWHBgFyyPz0VqYDAtprnCkjl1yxKxNR+/1Pg+zuU7SSaxI20iqUoduPzUQp894ipIxOppnDgCxC0Mw==',key_name='tempest-TestStampPattern-764832787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bfc3cefb0ef4063b439dcbd676372de',ramdisk_id='',reservation_id='r-93vmy134',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1852512142',owner_user_name='tempest-TestStampPattern-1852512142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:21:22Z,user_data=None,user_id='0cca4cdd12f543a2a5864f8a36f56cb4',uuid=f7858973-7146-4229-9f41-00ebcc7618b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "address": "fa:16:3e:54:ae:25", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0efcfa-7e", "ovs_interfaceid": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Converting VIF {"id": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "address": "fa:16:3e:54:ae:25", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0efcfa-7e", "ovs_interfaceid": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:ae:25,bridge_name='br-int',has_traffic_filtering=True,id=1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d,network=Network(500d3ecb-db5e-4d97-abcc-16264ba81220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0efcfa-7e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lazy-loading 'pci_devices' on Instance uuid f7858973-7146-4229-9f41-00ebcc7618b4 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:21:24 user nova-compute[71312]:   <uuid>f7858973-7146-4229-9f41-00ebcc7618b4</uuid>
Jul 25 10:21:24 user nova-compute[71312]:   <name>instance-00000027</name>
Jul 25 10:21:24 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:21:24 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:21:24 user nova-compute[71312]:   <metadata>
Jul 25 10:21:24 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:21:24 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:21:24 user nova-compute[71312]:       <nova:name>tempest-TestStampPattern-server-1391802317</nova:name>
Jul 25 10:21:24 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:21:24</nova:creationTime>
Jul 25 10:21:24 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:21:24 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:21:24 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:21:24 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:21:24 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:21:24 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:21:24 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:21:24 user nova-compute[71312]:       <nova:owner>
Jul 25 10:21:24 user nova-compute[71312]:         <nova:user uuid="0cca4cdd12f543a2a5864f8a36f56cb4">tempest-TestStampPattern-1852512142-project-member</nova:user>
Jul 25 10:21:24 user nova-compute[71312]:         <nova:project uuid="1bfc3cefb0ef4063b439dcbd676372de">tempest-TestStampPattern-1852512142</nova:project>
Jul 25 10:21:24 user nova-compute[71312]:       </nova:owner>
Jul 25 10:21:24 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:21:24 user nova-compute[71312]:       <nova:ports>
Jul 25 10:21:24 user nova-compute[71312]:         <nova:port uuid="1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d">
Jul 25 10:21:24 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 25 10:21:24 user nova-compute[71312]:         </nova:port>
Jul 25 10:21:24 user nova-compute[71312]:       </nova:ports>
Jul 25 10:21:24 user nova-compute[71312]:     </nova:instance>
Jul 25 10:21:24 user nova-compute[71312]:   </metadata>
Jul 25 10:21:24 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:21:24 user nova-compute[71312]:     <system>
Jul 25 10:21:24 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:21:24 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:21:24 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:21:24 user nova-compute[71312]:       <entry name="serial">f7858973-7146-4229-9f41-00ebcc7618b4</entry>
Jul 25 10:21:24 user nova-compute[71312]:       <entry name="uuid">f7858973-7146-4229-9f41-00ebcc7618b4</entry>
Jul 25 10:21:24 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:21:24 user nova-compute[71312]:     </system>
Jul 25 10:21:24 user nova-compute[71312]:   </sysinfo>
Jul 25 10:21:24 user nova-compute[71312]:   <os>
Jul 25 10:21:24 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:21:24 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:21:24 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:21:24 user nova-compute[71312]:   </os>
Jul 25 10:21:24 user nova-compute[71312]:   <features>
Jul 25 10:21:24 user nova-compute[71312]:     <acpi/>
Jul 25 10:21:24 user nova-compute[71312]:     <apic/>
Jul 25 10:21:24 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:21:24 user nova-compute[71312]:   </features>
Jul 25 10:21:24 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:21:24 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:21:24 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:21:24 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:21:24 user nova-compute[71312]:   </clock>
Jul 25 10:21:24 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:21:24 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:21:24 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:21:24 user nova-compute[71312]:   </cpu>
Jul 25 10:21:24 user nova-compute[71312]:   <devices>
Jul 25 10:21:24 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:21:24 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:21:24 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk"/>
Jul 25 10:21:24 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:21:24 user nova-compute[71312]:     </disk>
Jul 25 10:21:24 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:21:24 user nova-compute[71312]:       <mac address="fa:16:3e:54:ae:25"/>
Jul 25 10:21:24 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:21:24 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:21:24 user nova-compute[71312]:       <target dev="tap1f0efcfa-7e"/>
Jul 25 10:21:24 user nova-compute[71312]:     </interface>
Jul 25 10:21:24 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:21:24 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/console.log" append="off"/>
Jul 25 10:21:24 user nova-compute[71312]:     </serial>
Jul 25 10:21:24 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:21:24 user nova-compute[71312]:     <video>
Jul 25 10:21:24 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:21:24 user nova-compute[71312]:     </video>
Jul 25 10:21:24 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:21:24 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:21:24 user nova-compute[71312]:     </rng>
Jul 25 10:21:24 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:21:24 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:21:24 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:21:24 user nova-compute[71312]:     </memballoon>
Jul 25 10:21:24 user nova-compute[71312]:   </devices>
Jul 25 10:21:24 user nova-compute[71312]: </domain>
Jul 25 10:21:24 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1391802317',display_name='tempest-TestStampPattern-server-1391802317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1391802317',id=39,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO1P3w5txB81eBV0yGtov3Oc4MCOl8jqxiKKGPa9B1SJkwnNnhcpWHBgFyyPz0VqYDAtprnCkjl1yxKxNR+/1Pg+zuU7SSaxI20iqUoduPzUQp894ipIxOppnDgCxC0Mw==',key_name='tempest-TestStampPattern-764832787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bfc3cefb0ef4063b439dcbd676372de',ramdisk_id='',reservation_id='r-93vmy134',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1852512142',owner_user_name='tempest-TestStampPattern-1852512142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:21:22Z,user_data=None,user_id='0cca4cdd12f543a2a5864f8a36f56cb4',uuid=f7858973-7146-4229-9f41-00ebcc7618b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "address": "fa:16:3e:54:ae:25", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0efcfa-7e", "ovs_interfaceid": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Converting VIF {"id": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "address": "fa:16:3e:54:ae:25", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0efcfa-7e", "ovs_interfaceid": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:ae:25,bridge_name='br-int',has_traffic_filtering=True,id=1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d,network=Network(500d3ecb-db5e-4d97-abcc-16264ba81220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0efcfa-7e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG os_vif [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:ae:25,bridge_name='br-int',has_traffic_filtering=True,id=1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d,network=Network(500d3ecb-db5e-4d97-abcc-16264ba81220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0efcfa-7e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f0efcfa-7e, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f0efcfa-7e, col_values=(('external_ids', {'iface-id': '1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:ae:25', 'vm-uuid': 'f7858973-7146-4229-9f41-00ebcc7618b4'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:21:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:24 user nova-compute[71312]: INFO os_vif [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:ae:25,bridge_name='br-int',has_traffic_filtering=True,id=1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d,network=Network(500d3ecb-db5e-4d97-abcc-16264ba81220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0efcfa-7e')
Jul 25 10:21:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:21:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] No VIF found with MAC fa:16:3e:54:ae:25, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:21:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-730155d8-ba6e-4e53-a2d5-ffc9b925253f req-50ea4cec-cc2f-46b8-9eb5-275e50360b4e service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Updated VIF entry in instance network info cache for port 1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:21:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-730155d8-ba6e-4e53-a2d5-ffc9b925253f req-50ea4cec-cc2f-46b8-9eb5-275e50360b4e service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Updating instance_info_cache with network_info: [{"id": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "address": "fa:16:3e:54:ae:25", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0efcfa-7e", "ovs_interfaceid": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:21:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-730155d8-ba6e-4e53-a2d5-ffc9b925253f req-50ea4cec-cc2f-46b8-9eb5-275e50360b4e service nova] Releasing lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:21:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-755fa68e-991d-4641-95c4-2bde2454d5a0 req-dc51d1bb-3c23-4c28-9b82-8b477cf321bc service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Received event network-vif-plugged-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:21:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-755fa68e-991d-4641-95c4-2bde2454d5a0 req-dc51d1bb-3c23-4c28-9b82-8b477cf321bc service nova] Acquiring lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:21:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-755fa68e-991d-4641-95c4-2bde2454d5a0 req-dc51d1bb-3c23-4c28-9b82-8b477cf321bc service nova] Lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:21:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-755fa68e-991d-4641-95c4-2bde2454d5a0 req-dc51d1bb-3c23-4c28-9b82-8b477cf321bc service nova] Lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:21:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-755fa68e-991d-4641-95c4-2bde2454d5a0 req-dc51d1bb-3c23-4c28-9b82-8b477cf321bc service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] No waiting events found dispatching network-vif-plugged-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:21:26 user nova-compute[71312]: WARNING nova.compute.manager [req-755fa68e-991d-4641-95c4-2bde2454d5a0 req-dc51d1bb-3c23-4c28-9b82-8b477cf321bc service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Received unexpected event network-vif-plugged-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d for instance with vm_state building and task_state spawning.
Jul 25 10:21:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280488.8538015, f7858973-7146-4229-9f41-00ebcc7618b4 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:21:28 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] VM Resumed (Lifecycle Event)
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:21:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Instance spawned successfully.
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:21:28 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280488.8548365, f7858973-7146-4229-9f41-00ebcc7618b4 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:21:28 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] VM Started (Lifecycle Event)
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:21:28 user nova-compute[71312]: INFO nova.compute.manager [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Took 7.07 seconds to spawn the instance on the hypervisor.
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:21:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:21:29 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:21:29 user nova-compute[71312]: INFO nova.compute.manager [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Took 7.74 seconds to build instance.
Jul 25 10:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5090f6b0-7a68-477c-a1d7-e1639ef17b8b tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "f7858973-7146-4229-9f41-00ebcc7618b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.896s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:21:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-667855d7-4542-4162-a352-1fb47f4f32be req-06269ec5-0d13-4453-8ae4-8083cb606b12 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Received event network-vif-plugged-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-667855d7-4542-4162-a352-1fb47f4f32be req-06269ec5-0d13-4453-8ae4-8083cb606b12 service nova] Acquiring lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-667855d7-4542-4162-a352-1fb47f4f32be req-06269ec5-0d13-4453-8ae4-8083cb606b12 service nova] Lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-667855d7-4542-4162-a352-1fb47f4f32be req-06269ec5-0d13-4453-8ae4-8083cb606b12 service nova] Lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:21:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-667855d7-4542-4162-a352-1fb47f4f32be req-06269ec5-0d13-4453-8ae4-8083cb606b12 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] No waiting events found dispatching network-vif-plugged-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:21:29 user nova-compute[71312]: WARNING nova.compute.manager [req-667855d7-4542-4162-a352-1fb47f4f32be req-06269ec5-0d13-4453-8ae4-8083cb606b12 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Received unexpected event network-vif-plugged-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d for instance with vm_state active and task_state None.
Jul 25 10:21:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:21:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:21:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:21:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:21:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Updating instance_info_cache with network_info: [{"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:21:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:21:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:21:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:21:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:21:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:21:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:21:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:21:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:21:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:21:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:21:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:21:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:21:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:40 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:21:40 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:21:40 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8195MB free_disk=25.291358947753906GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:21:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:21:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:21:40 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:21:40 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:21:40 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 6471ba37-ab4e-4610-927e-ba5639b0fc91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:21:40 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f7858973-7146-4229-9f41-00ebcc7618b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:21:40 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:21:40 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:21:40 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing inventories for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 10:21:40 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Updating ProviderTree inventory for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 10:21:40 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Updating inventory in ProviderTree for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 10:21:40 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing aggregate associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 10:21:40 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing trait associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, traits: COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 10:21:41 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:21:41 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:21:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:21:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.713s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:21:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:21:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 10:21:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 10:21:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:21:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:21:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "82f8117b-e142-48a7-ba13-a697f2603958" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:21:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "82f8117b-e142-48a7-ba13-a697f2603958" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:21:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:21:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:21:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:21:44 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:21:44 user nova-compute[71312]: INFO nova.compute.claims [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Claim successful on node user
Jul 25 10:21:44 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:21:44 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:21:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:21:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:21:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:21:44 user nova-compute[71312]: DEBUG nova.network.neutron [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:21:44 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:21:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:21:44 user nova-compute[71312]: INFO nova.virt.block_device [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Booting with volume snapshot ee36c769-1058-43d9-ac04-f3f70abb09eb at /dev/vda
Jul 25 10:21:44 user nova-compute[71312]: DEBUG nova.policy [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b15229b8fb22457ca38b9c5bf2f6dbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55fc0544c744824b3b999ecfcf11e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:21:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Successfully created port: f4e3d280-9577-4007-9e9b-33a3fe19d521 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:21:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Successfully updated port: f4e3d280-9577-4007-9e9b-33a3fe19d521 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:21:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "refresh_cache-82f8117b-e142-48a7-ba13-a697f2603958" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:21:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquired lock "refresh_cache-82f8117b-e142-48a7-ba13-a697f2603958" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:21:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:21:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-112ecf97-e8a9-498e-a581-966db6f50efe req-a6dc8c55-47c5-4ebe-b4e1-6b98c68ef5d8 service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Received event network-changed-f4e3d280-9577-4007-9e9b-33a3fe19d521 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:21:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-112ecf97-e8a9-498e-a581-966db6f50efe req-a6dc8c55-47c5-4ebe-b4e1-6b98c68ef5d8 service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Refreshing instance network info cache due to event network-changed-f4e3d280-9577-4007-9e9b-33a3fe19d521. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:21:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-112ecf97-e8a9-498e-a581-966db6f50efe req-a6dc8c55-47c5-4ebe-b4e1-6b98c68ef5d8 service nova] Acquiring lock "refresh_cache-82f8117b-e142-48a7-ba13-a697f2603958" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:21:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:21:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:21:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 10:21:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Updating instance_info_cache with network_info: [{"id": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "address": "fa:16:3e:1e:4e:d6", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e3d280-95", "ovs_interfaceid": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:21:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Releasing lock "refresh_cache-82f8117b-e142-48a7-ba13-a697f2603958" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:21:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Instance network_info: |[{"id": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "address": "fa:16:3e:1e:4e:d6", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e3d280-95", "ovs_interfaceid": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:21:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-112ecf97-e8a9-498e-a581-966db6f50efe req-a6dc8c55-47c5-4ebe-b4e1-6b98c68ef5d8 service nova] Acquired lock "refresh_cache-82f8117b-e142-48a7-ba13-a697f2603958" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:21:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-112ecf97-e8a9-498e-a581-966db6f50efe req-a6dc8c55-47c5-4ebe-b4e1-6b98c68ef5d8 service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Refreshing network info cache for port f4e3d280-9577-4007-9e9b-33a3fe19d521 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:21:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-112ecf97-e8a9-498e-a581-966db6f50efe req-a6dc8c55-47c5-4ebe-b4e1-6b98c68ef5d8 service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Updated VIF entry in instance network info cache for port f4e3d280-9577-4007-9e9b-33a3fe19d521. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:21:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-112ecf97-e8a9-498e-a581-966db6f50efe req-a6dc8c55-47c5-4ebe-b4e1-6b98c68ef5d8 service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Updating instance_info_cache with network_info: [{"id": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "address": "fa:16:3e:1e:4e:d6", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e3d280-95", "ovs_interfaceid": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:21:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-112ecf97-e8a9-498e-a581-966db6f50efe req-a6dc8c55-47c5-4ebe-b4e1-6b98c68ef5d8 service nova] Releasing lock "refresh_cache-82f8117b-e142-48a7-ba13-a697f2603958" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:21:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG os_brick.utils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[406e8a9f-9e97-4c52-a47a-c6ae3215d1d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[926152af-0585-4353-bb71-4fd968469683]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b49c8b-612b-43bc-a231-5bbd1c2e0a2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8f946a-02c5-4e82-bec0-76b74215db4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:21:50 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:21:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[88603e58-9d1c-48b0-a41d-a31cdeee77e1]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG os_brick.utils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:21:50 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Updating existing volume attachment record: 49a6d40d-f5fd-44b3-b8fe-0440337ee7b4 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:21:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:21:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:21:57 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Creating image(s)
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Ensure instance console log exists: /opt/stack/data/nova/instances/82f8117b-e142-48a7-ba13-a697f2603958/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Start _get_guest_xml network_info=[{"id": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "address": "fa:16:3e:1e:4e:d6", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e3d280-95", "ovs_interfaceid": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '49a6d40d-f5fd-44b3-b8fe-0440337ee7b4', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbqUnAzK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82f8117b-e142-48a7-ba13-a697f2603958', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb741f4f-5892-4a16-bd0c-469c6bd39652', 'serial': 'bb741f4f-5892-4a16-bd0c-469c6bd39652'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:21:57 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:21:57 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbqUnAzK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:21:57 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:21:57 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:21:57 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eb1f0f-ca16-440e-bcf9-b584635756e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:21:57 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31afc16-74c5-4ca5-9de8-7633d6dac922]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652] added
Jul 25 10:21:57 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fffdce1-32cd-49ea-8cfe-1e7af65f20f3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b304068f-7dc3-4c9c-8c6c-d9b305650f86]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hbqUnAzK {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hbqUnAzK" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ebdda8-aaaa-4b6e-a537-c289bf631341]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hbqUnAzK'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[97149cd1-4b50-4463-9372-436452a1b663]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[efee380b-01e9-4dc1-96d3-91fa6eea14f0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c67fd09-247d-4606-bdc2-1ffe25db5962 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c67fd09-247d-4606-bdc2-1ffe25db5962 (non-flash)
Jul 25 10:21:57 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c67fd09-247d-4606-bdc2-1ffe25db5962 (non-flash)
Jul 25 10:21:57 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8b4f16-42d4-4ba1-9c55-b7814e98e5c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652, portal: 172.16.0.220,3260]
Jul 25 10:21:57 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652, portal: 172.16.0.220,3260] successful.
Jul 25 10:21:57 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba4dbd8-f8ab-408d-97ab-5593a5ed9191]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[59538b6a-bf66-43db-b942-369127327e57]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c67fd09-247d-4606-bdc2-1ffe25db5962 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c67fd09-247d-4606-bdc2-1ffe25db5962 (non-flash)
Jul 25 10:21:57 user nova-compute[71312]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:21:57 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c67fd09-247d-4606-bdc2-1ffe25db5962 (non-flash)
Jul 25 10:21:57 user nova-compute[71312]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:21:57 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca07ce3-3e0b-4285-a683-8cd99abca0c1]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:21:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbqUnAzK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23765386630316333', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765386630316333', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1368570295',display_name='tempest-TestVolumeBootPattern-server-1368570295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1368570295',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-30q7o7du',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:21:45Z,user_data=None,user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=82f8117b-e142-48a7-ba13-a697f2603958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "address": "fa:16:3e:1e:4e:d6", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e3d280-95", "ovs_interfaceid": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "address": "fa:16:3e:1e:4e:d6", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e3d280-95", "ovs_interfaceid": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f4e3d280-9577-4007-9e9b-33a3fe19d521,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e3d280-95') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG nova.objects.instance [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lazy-loading 'pci_devices' on Instance uuid 82f8117b-e142-48a7-ba13-a697f2603958 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:21:58 user nova-compute[71312]:   <uuid>82f8117b-e142-48a7-ba13-a697f2603958</uuid>
Jul 25 10:21:58 user nova-compute[71312]:   <name>instance-00000028</name>
Jul 25 10:21:58 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:21:58 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:21:58 user nova-compute[71312]:   <metadata>
Jul 25 10:21:58 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:21:58 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:21:58 user nova-compute[71312]:       <nova:name>tempest-TestVolumeBootPattern-server-1368570295</nova:name>
Jul 25 10:21:58 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:21:57</nova:creationTime>
Jul 25 10:21:58 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:21:58 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:21:58 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:21:58 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:21:58 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:21:58 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:21:58 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:21:58 user nova-compute[71312]:       <nova:owner>
Jul 25 10:21:58 user nova-compute[71312]:         <nova:user uuid="b15229b8fb22457ca38b9c5bf2f6dbc3">tempest-TestVolumeBootPattern-614700428-project-member</nova:user>
Jul 25 10:21:58 user nova-compute[71312]:         <nova:project uuid="e55fc0544c744824b3b999ecfcf11e31">tempest-TestVolumeBootPattern-614700428</nova:project>
Jul 25 10:21:58 user nova-compute[71312]:       </nova:owner>
Jul 25 10:21:58 user nova-compute[71312]:       <nova:ports>
Jul 25 10:21:58 user nova-compute[71312]:         <nova:port uuid="f4e3d280-9577-4007-9e9b-33a3fe19d521">
Jul 25 10:21:58 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 10:21:58 user nova-compute[71312]:         </nova:port>
Jul 25 10:21:58 user nova-compute[71312]:       </nova:ports>
Jul 25 10:21:58 user nova-compute[71312]:     </nova:instance>
Jul 25 10:21:58 user nova-compute[71312]:   </metadata>
Jul 25 10:21:58 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:21:58 user nova-compute[71312]:     <system>
Jul 25 10:21:58 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:21:58 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:21:58 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:21:58 user nova-compute[71312]:       <entry name="serial">82f8117b-e142-48a7-ba13-a697f2603958</entry>
Jul 25 10:21:58 user nova-compute[71312]:       <entry name="uuid">82f8117b-e142-48a7-ba13-a697f2603958</entry>
Jul 25 10:21:58 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:21:58 user nova-compute[71312]:     </system>
Jul 25 10:21:58 user nova-compute[71312]:   </sysinfo>
Jul 25 10:21:58 user nova-compute[71312]:   <os>
Jul 25 10:21:58 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:21:58 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:21:58 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:21:58 user nova-compute[71312]:   </os>
Jul 25 10:21:58 user nova-compute[71312]:   <features>
Jul 25 10:21:58 user nova-compute[71312]:     <acpi/>
Jul 25 10:21:58 user nova-compute[71312]:     <apic/>
Jul 25 10:21:58 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:21:58 user nova-compute[71312]:   </features>
Jul 25 10:21:58 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:21:58 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:21:58 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:21:58 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:21:58 user nova-compute[71312]:   </clock>
Jul 25 10:21:58 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:21:58 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:21:58 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:21:58 user nova-compute[71312]:   </cpu>
Jul 25 10:21:58 user nova-compute[71312]:   <devices>
Jul 25 10:21:58 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:21:58 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:21:58 user nova-compute[71312]:       <source dev="/dev/sdc"/>
Jul 25 10:21:58 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:21:58 user nova-compute[71312]:       <serial>bb741f4f-5892-4a16-bd0c-469c6bd39652</serial>
Jul 25 10:21:58 user nova-compute[71312]:     </disk>
Jul 25 10:21:58 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:21:58 user nova-compute[71312]:       <mac address="fa:16:3e:1e:4e:d6"/>
Jul 25 10:21:58 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:21:58 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:21:58 user nova-compute[71312]:       <target dev="tapf4e3d280-95"/>
Jul 25 10:21:58 user nova-compute[71312]:     </interface>
Jul 25 10:21:58 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:21:58 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/82f8117b-e142-48a7-ba13-a697f2603958/console.log" append="off"/>
Jul 25 10:21:58 user nova-compute[71312]:     </serial>
Jul 25 10:21:58 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:21:58 user nova-compute[71312]:     <video>
Jul 25 10:21:58 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:21:58 user nova-compute[71312]:     </video>
Jul 25 10:21:58 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:21:58 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:21:58 user nova-compute[71312]:     </rng>
Jul 25 10:21:58 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:21:58 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:21:58 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:21:58 user nova-compute[71312]:     </memballoon>
Jul 25 10:21:58 user nova-compute[71312]:   </devices>
Jul 25 10:21:58 user nova-compute[71312]: </domain>
Jul 25 10:21:58 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1368570295',display_name='tempest-TestVolumeBootPattern-server-1368570295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1368570295',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-30q7o7du',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:21:45Z,user_data=None,user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=82f8117b-e142-48a7-ba13-a697f2603958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "address": "fa:16:3e:1e:4e:d6", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e3d280-95", "ovs_interfaceid": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "address": "fa:16:3e:1e:4e:d6", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e3d280-95", "ovs_interfaceid": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f4e3d280-9577-4007-9e9b-33a3fe19d521,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e3d280-95') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG os_vif [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f4e3d280-9577-4007-9e9b-33a3fe19d521,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e3d280-95') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4e3d280-95, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4e3d280-95, col_values=(('external_ids', {'iface-id': 'f4e3d280-9577-4007-9e9b-33a3fe19d521', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:4e:d6', 'vm-uuid': '82f8117b-e142-48a7-ba13-a697f2603958'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:21:58 user nova-compute[71312]: INFO os_vif [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f4e3d280-9577-4007-9e9b-33a3fe19d521,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e3d280-95')
Jul 25 10:21:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:21:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] No VIF found with MAC fa:16:3e:1e:4e:d6, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:22:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-0dfe6f16-b633-4c98-a1df-841dc4635366 req-c33b22a9-e345-48eb-98a1-b488698da5eb service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Received event network-vif-plugged-f4e3d280-9577-4007-9e9b-33a3fe19d521 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:22:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0dfe6f16-b633-4c98-a1df-841dc4635366 req-c33b22a9-e345-48eb-98a1-b488698da5eb service nova] Acquiring lock "82f8117b-e142-48a7-ba13-a697f2603958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0dfe6f16-b633-4c98-a1df-841dc4635366 req-c33b22a9-e345-48eb-98a1-b488698da5eb service nova] Lock "82f8117b-e142-48a7-ba13-a697f2603958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0dfe6f16-b633-4c98-a1df-841dc4635366 req-c33b22a9-e345-48eb-98a1-b488698da5eb service nova] Lock "82f8117b-e142-48a7-ba13-a697f2603958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-0dfe6f16-b633-4c98-a1df-841dc4635366 req-c33b22a9-e345-48eb-98a1-b488698da5eb service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] No waiting events found dispatching network-vif-plugged-f4e3d280-9577-4007-9e9b-33a3fe19d521 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:22:00 user nova-compute[71312]: WARNING nova.compute.manager [req-0dfe6f16-b633-4c98-a1df-841dc4635366 req-c33b22a9-e345-48eb-98a1-b488698da5eb service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Received unexpected event network-vif-plugged-f4e3d280-9577-4007-9e9b-33a3fe19d521 for instance with vm_state building and task_state spawning.
Jul 25 10:22:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280522.3737864, 82f8117b-e142-48a7-ba13-a697f2603958 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:22:02 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] VM Resumed (Lifecycle Event)
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:22:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Instance spawned successfully.
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:22:02 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280522.3778617, 82f8117b-e142-48a7-ba13-a697f2603958 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:22:02 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] VM Started (Lifecycle Event)
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:22:02 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:22:02 user nova-compute[71312]: INFO nova.compute.manager [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Took 5.09 seconds to spawn the instance on the hypervisor.
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:22:02 user nova-compute[71312]: INFO nova.compute.manager [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Took 18.18 seconds to build instance.
Jul 25 10:22:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-36a5aefe-d534-4475-8a47-1c4db344f2eb tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "82f8117b-e142-48a7-ba13-a697f2603958" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.364s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-be7c1650-8a72-485f-afc6-e912b42c38cf req-52d2aa8b-5d7a-4182-9505-87af4f28990f service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Received event network-vif-plugged-f4e3d280-9577-4007-9e9b-33a3fe19d521 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-be7c1650-8a72-485f-afc6-e912b42c38cf req-52d2aa8b-5d7a-4182-9505-87af4f28990f service nova] Acquiring lock "82f8117b-e142-48a7-ba13-a697f2603958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-be7c1650-8a72-485f-afc6-e912b42c38cf req-52d2aa8b-5d7a-4182-9505-87af4f28990f service nova] Lock "82f8117b-e142-48a7-ba13-a697f2603958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-be7c1650-8a72-485f-afc6-e912b42c38cf req-52d2aa8b-5d7a-4182-9505-87af4f28990f service nova] Lock "82f8117b-e142-48a7-ba13-a697f2603958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-be7c1650-8a72-485f-afc6-e912b42c38cf req-52d2aa8b-5d7a-4182-9505-87af4f28990f service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] No waiting events found dispatching network-vif-plugged-f4e3d280-9577-4007-9e9b-33a3fe19d521 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:22:02 user nova-compute[71312]: WARNING nova.compute.manager [req-be7c1650-8a72-485f-afc6-e912b42c38cf req-52d2aa8b-5d7a-4182-9505-87af4f28990f service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Received unexpected event network-vif-plugged-f4e3d280-9577-4007-9e9b-33a3fe19d521 for instance with vm_state active and task_state None.
Jul 25 10:22:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:22:27 user nova-compute[71312]: INFO nova.compute.claims [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Claim successful on node user
Jul 25 10:22:27 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:22:27 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:22:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG nova.policy [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12610a082fb54137a6c6752c800bd393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd929f478538e4a13808c730ae670e6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:22:27 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Creating image(s)
Jul 25 10:22:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "/opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "/opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "/opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "5aef01b17120e8d68e8fe7895dd24d9b1776ddf0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "5aef01b17120e8d68e8fe7895dd24d9b1776ddf0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0.part --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:28 user nova-compute[71312]: DEBUG nova.virt.images [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] d9c394da-76f3-4440-a72f-e13318a0982c was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 10:22:28 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:22:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0.part /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Successfully created port: 21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:22:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0.part /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0.converted" returned: 0 in 0.369s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "5aef01b17120e8d68e8fe7895dd24d9b1776ddf0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.201s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0 --force-share --output=json" returned: 0 in 0.166s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "5aef01b17120e8d68e8fe7895dd24d9b1776ddf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "5aef01b17120e8d68e8fe7895dd24d9b1776ddf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Successfully updated port: 21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquired lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0 --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0,backing_fmt=raw /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-084f79b5-f368-42ff-bb84-60aed12dc59f req-795a76b7-bea2-47c0-b3a4-33837b37b4f3 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-changed-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-084f79b5-f368-42ff-bb84-60aed12dc59f req-795a76b7-bea2-47c0-b3a4-33837b37b4f3 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Refreshing instance network info cache due to event network-changed-21c48988-5022-49f7-baa0-a10dfdc879bd. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-084f79b5-f368-42ff-bb84-60aed12dc59f req-795a76b7-bea2-47c0-b3a4-33837b37b4f3 service nova] Acquiring lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0,backing_fmt=raw /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk 1073741824" returned: 0 in 0.194s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "5aef01b17120e8d68e8fe7895dd24d9b1776ddf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0 --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updating instance_info_cache with network_info: [{"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Cannot resize image /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'migration_context' on Instance uuid 411b2cee-bb2d-4b65-921c-3248c1edc454 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Releasing lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Instance network_info: |[{"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Ensure instance console log exists: /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Start _get_guest_xml network_info=[{"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T10:22:24Z,direct_url=<?>,disk_format='qcow2',id=d9c394da-76f3-4440-a72f-e13318a0982c,min_disk=0,min_ram=0,name='tempest-scenario-img--588345263',owner='d929f478538e4a13808c730ae670e6ac',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T10:22:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'd9c394da-76f3-4440-a72f-e13318a0982c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-084f79b5-f368-42ff-bb84-60aed12dc59f req-795a76b7-bea2-47c0-b3a4-33837b37b4f3 service nova] Acquired lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-084f79b5-f368-42ff-bb84-60aed12dc59f req-795a76b7-bea2-47c0-b3a4-33837b37b4f3 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Refreshing network info cache for port 21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:22:29 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:22:29 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T10:22:24Z,direct_url=<?>,disk_format='qcow2',id=d9c394da-76f3-4440-a72f-e13318a0982c,min_disk=0,min_ram=0,name='tempest-scenario-img--588345263',owner='d929f478538e4a13808c730ae670e6ac',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T10:22:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1650432608',display_name='tempest-TestMinimumBasicScenario-server-1650432608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1650432608',id=41,image_ref='d9c394da-76f3-4440-a72f-e13318a0982c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGg3j14zcpk1Y5NEPPiDHV/l/W/r76eTIQ6WTapG9XZ5IbgVeFP1qKyfBeaNpLBhqdsADos6R8ho5+EZ8JxYEhwl8T8FnA+Tk0HcWqExlEpdX5Ph68BTxiht5yVBbwwmA==',key_name='tempest-TestMinimumBasicScenario-271951688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d929f478538e4a13808c730ae670e6ac',ramdisk_id='',reservation_id='r-pxzhwxzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d9c394da-76f3-4440-a72f-e13318a0982c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1169366909',owner_user_name='tempest-TestMinimumBasicScenario-1169366909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:22:28Z,user_data=None,user_id='12610a082fb54137a6c6752c800bd393',uuid=411b2cee-bb2d-4b65-921c-3248c1edc454,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converting VIF {"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:42:1f,bridge_name='br-int',has_traffic_filtering=True,id=21c48988-5022-49f7-baa0-a10dfdc879bd,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c48988-50') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'pci_devices' on Instance uuid 411b2cee-bb2d-4b65-921c-3248c1edc454 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:22:29 user nova-compute[71312]:   <uuid>411b2cee-bb2d-4b65-921c-3248c1edc454</uuid>
Jul 25 10:22:29 user nova-compute[71312]:   <name>instance-00000029</name>
Jul 25 10:22:29 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:22:29 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:22:29 user nova-compute[71312]:   <metadata>
Jul 25 10:22:29 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:22:29 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:22:29 user nova-compute[71312]:       <nova:name>tempest-TestMinimumBasicScenario-server-1650432608</nova:name>
Jul 25 10:22:29 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:22:29</nova:creationTime>
Jul 25 10:22:29 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:22:29 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:22:29 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:22:29 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:22:29 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:22:29 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:22:29 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:22:29 user nova-compute[71312]:       <nova:owner>
Jul 25 10:22:29 user nova-compute[71312]:         <nova:user uuid="12610a082fb54137a6c6752c800bd393">tempest-TestMinimumBasicScenario-1169366909-project-member</nova:user>
Jul 25 10:22:29 user nova-compute[71312]:         <nova:project uuid="d929f478538e4a13808c730ae670e6ac">tempest-TestMinimumBasicScenario-1169366909</nova:project>
Jul 25 10:22:29 user nova-compute[71312]:       </nova:owner>
Jul 25 10:22:29 user nova-compute[71312]:       <nova:root type="image" uuid="d9c394da-76f3-4440-a72f-e13318a0982c"/>
Jul 25 10:22:29 user nova-compute[71312]:       <nova:ports>
Jul 25 10:22:29 user nova-compute[71312]:         <nova:port uuid="21c48988-5022-49f7-baa0-a10dfdc879bd">
Jul 25 10:22:29 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 10:22:29 user nova-compute[71312]:         </nova:port>
Jul 25 10:22:29 user nova-compute[71312]:       </nova:ports>
Jul 25 10:22:29 user nova-compute[71312]:     </nova:instance>
Jul 25 10:22:29 user nova-compute[71312]:   </metadata>
Jul 25 10:22:29 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:22:29 user nova-compute[71312]:     <system>
Jul 25 10:22:29 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:22:29 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:22:29 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:22:29 user nova-compute[71312]:       <entry name="serial">411b2cee-bb2d-4b65-921c-3248c1edc454</entry>
Jul 25 10:22:29 user nova-compute[71312]:       <entry name="uuid">411b2cee-bb2d-4b65-921c-3248c1edc454</entry>
Jul 25 10:22:29 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:22:29 user nova-compute[71312]:     </system>
Jul 25 10:22:29 user nova-compute[71312]:   </sysinfo>
Jul 25 10:22:29 user nova-compute[71312]:   <os>
Jul 25 10:22:29 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:22:29 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:22:29 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:22:29 user nova-compute[71312]:   </os>
Jul 25 10:22:29 user nova-compute[71312]:   <features>
Jul 25 10:22:29 user nova-compute[71312]:     <acpi/>
Jul 25 10:22:29 user nova-compute[71312]:     <apic/>
Jul 25 10:22:29 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:22:29 user nova-compute[71312]:   </features>
Jul 25 10:22:29 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:22:29 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:22:29 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:22:29 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:22:29 user nova-compute[71312]:   </clock>
Jul 25 10:22:29 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:22:29 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:22:29 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:22:29 user nova-compute[71312]:   </cpu>
Jul 25 10:22:29 user nova-compute[71312]:   <devices>
Jul 25 10:22:29 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:22:29 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:22:29 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk"/>
Jul 25 10:22:29 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:22:29 user nova-compute[71312]:     </disk>
Jul 25 10:22:29 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:22:29 user nova-compute[71312]:       <mac address="fa:16:3e:61:42:1f"/>
Jul 25 10:22:29 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:22:29 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:22:29 user nova-compute[71312]:       <target dev="tap21c48988-50"/>
Jul 25 10:22:29 user nova-compute[71312]:     </interface>
Jul 25 10:22:29 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:22:29 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/console.log" append="off"/>
Jul 25 10:22:29 user nova-compute[71312]:     </serial>
Jul 25 10:22:29 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:22:29 user nova-compute[71312]:     <video>
Jul 25 10:22:29 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:22:29 user nova-compute[71312]:     </video>
Jul 25 10:22:29 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:22:29 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:22:29 user nova-compute[71312]:     </rng>
Jul 25 10:22:29 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:22:29 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:22:29 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:22:29 user nova-compute[71312]:     </memballoon>
Jul 25 10:22:29 user nova-compute[71312]:   </devices>
Jul 25 10:22:29 user nova-compute[71312]: </domain>
Jul 25 10:22:29 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1650432608',display_name='tempest-TestMinimumBasicScenario-server-1650432608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1650432608',id=41,image_ref='d9c394da-76f3-4440-a72f-e13318a0982c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGg3j14zcpk1Y5NEPPiDHV/l/W/r76eTIQ6WTapG9XZ5IbgVeFP1qKyfBeaNpLBhqdsADos6R8ho5+EZ8JxYEhwl8T8FnA+Tk0HcWqExlEpdX5Ph68BTxiht5yVBbwwmA==',key_name='tempest-TestMinimumBasicScenario-271951688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d929f478538e4a13808c730ae670e6ac',ramdisk_id='',reservation_id='r-pxzhwxzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d9c394da-76f3-4440-a72f-e13318a0982c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1169366909',owner_user_name='tempest-TestMinimumBasicScenario-1169366909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:22:28Z,user_data=None,user_id='12610a082fb54137a6c6752c800bd393',uuid=411b2cee-bb2d-4b65-921c-3248c1edc454,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converting VIF {"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:42:1f,bridge_name='br-int',has_traffic_filtering=True,id=21c48988-5022-49f7-baa0-a10dfdc879bd,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c48988-50') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG os_vif [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:42:1f,bridge_name='br-int',has_traffic_filtering=True,id=21c48988-5022-49f7-baa0-a10dfdc879bd,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c48988-50') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21c48988-50, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21c48988-50, col_values=(('external_ids', {'iface-id': '21c48988-5022-49f7-baa0-a10dfdc879bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:42:1f', 'vm-uuid': '411b2cee-bb2d-4b65-921c-3248c1edc454'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:29 user nova-compute[71312]: INFO os_vif [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:42:1f,bridge_name='br-int',has_traffic_filtering=True,id=21c48988-5022-49f7-baa0-a10dfdc879bd,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c48988-50')
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] No VIF found with MAC fa:16:3e:61:42:1f, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:22:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:22:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-084f79b5-f368-42ff-bb84-60aed12dc59f req-795a76b7-bea2-47c0-b3a4-33837b37b4f3 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updated VIF entry in instance network info cache for port 21c48988-5022-49f7-baa0-a10dfdc879bd. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:22:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-084f79b5-f368-42ff-bb84-60aed12dc59f req-795a76b7-bea2-47c0-b3a4-33837b37b4f3 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updating instance_info_cache with network_info: [{"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:22:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-084f79b5-f368-42ff-bb84-60aed12dc59f req-795a76b7-bea2-47c0-b3a4-33837b37b4f3 service nova] Releasing lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:22:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Updating instance_info_cache with network_info: [{"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:22:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:22:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:22:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-e2cddbe5-8fd8-4917-8675-85122269bd2d req-7967a989-cc23-4358-a8e7-052f42e42858 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:22:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e2cddbe5-8fd8-4917-8675-85122269bd2d req-7967a989-cc23-4358-a8e7-052f42e42858 service nova] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e2cddbe5-8fd8-4917-8675-85122269bd2d req-7967a989-cc23-4358-a8e7-052f42e42858 service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e2cddbe5-8fd8-4917-8675-85122269bd2d req-7967a989-cc23-4358-a8e7-052f42e42858 service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-e2cddbe5-8fd8-4917-8675-85122269bd2d req-7967a989-cc23-4358-a8e7-052f42e42858 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] No waiting events found dispatching network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:22:31 user nova-compute[71312]: WARNING nova.compute.manager [req-e2cddbe5-8fd8-4917-8675-85122269bd2d req-7967a989-cc23-4358-a8e7-052f42e42858 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received unexpected event network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd for instance with vm_state building and task_state spawning.
Jul 25 10:22:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:22:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:22:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:22:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280553.1851265, 411b2cee-bb2d-4b65-921c-3248c1edc454 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:22:33 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] VM Resumed (Lifecycle Event)
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:22:33 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Instance spawned successfully.
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:22:33 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280553.1895723, 411b2cee-bb2d-4b65-921c-3248c1edc454 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:22:33 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] VM Started (Lifecycle Event)
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:22:33 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:22:33 user nova-compute[71312]: INFO nova.compute.manager [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Took 5.73 seconds to spawn the instance on the hypervisor.
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:22:33 user nova-compute[71312]: INFO nova.compute.manager [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Took 6.38 seconds to build instance.
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-e769e9e1-e8b9-4f18-9139-333bfb3542c2 req-4e2ca386-3c1b-4df7-ae39-341e6a9ace7d service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e769e9e1-e8b9-4f18-9139-333bfb3542c2 req-4e2ca386-3c1b-4df7-ae39-341e6a9ace7d service nova] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e769e9e1-e8b9-4f18-9139-333bfb3542c2 req-4e2ca386-3c1b-4df7-ae39-341e6a9ace7d service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e769e9e1-e8b9-4f18-9139-333bfb3542c2 req-4e2ca386-3c1b-4df7-ae39-341e6a9ace7d service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-e769e9e1-e8b9-4f18-9139-333bfb3542c2 req-4e2ca386-3c1b-4df7-ae39-341e6a9ace7d service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] No waiting events found dispatching network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:22:33 user nova-compute[71312]: WARNING nova.compute.manager [req-e769e9e1-e8b9-4f18-9139-333bfb3542c2 req-4e2ca386-3c1b-4df7-ae39-341e6a9ace7d service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received unexpected event network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd for instance with vm_state active and task_state None.
Jul 25 10:22:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a13e2aec-8443-469b-bad8-e47fcd64c03e tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.515s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:22:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:22:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-1c88c9ed-52da-4d90-9397-871c91f3b1e4 req-f087e40a-a73a-451f-bbd6-bdb1b5030ddf service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Received event network-changed-7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:22:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-1c88c9ed-52da-4d90-9397-871c91f3b1e4 req-f087e40a-a73a-451f-bbd6-bdb1b5030ddf service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Refreshing instance network info cache due to event network-changed-7ddc7200-6a27-491b-834b-101bb1e0b1ba. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:22:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1c88c9ed-52da-4d90-9397-871c91f3b1e4 req-f087e40a-a73a-451f-bbd6-bdb1b5030ddf service nova] Acquiring lock "refresh_cache-6471ba37-ab4e-4610-927e-ba5639b0fc91" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:22:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1c88c9ed-52da-4d90-9397-871c91f3b1e4 req-f087e40a-a73a-451f-bbd6-bdb1b5030ddf service nova] Acquired lock "refresh_cache-6471ba37-ab4e-4610-927e-ba5639b0fc91" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:22:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-1c88c9ed-52da-4d90-9397-871c91f3b1e4 req-f087e40a-a73a-451f-bbd6-bdb1b5030ddf service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Refreshing network info cache for port 7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:22:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-1c88c9ed-52da-4d90-9397-871c91f3b1e4 req-f087e40a-a73a-451f-bbd6-bdb1b5030ddf service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Updated VIF entry in instance network info cache for port 7ddc7200-6a27-491b-834b-101bb1e0b1ba. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:22:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-1c88c9ed-52da-4d90-9397-871c91f3b1e4 req-f087e40a-a73a-451f-bbd6-bdb1b5030ddf service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Updating instance_info_cache with network_info: [{"id": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "address": "fa:16:3e:42:7e:64", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddc7200-6a", "ovs_interfaceid": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:22:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1c88c9ed-52da-4d90-9397-871c91f3b1e4 req-f087e40a-a73a-451f-bbd6-bdb1b5030ddf service nova] Releasing lock "refresh_cache-6471ba37-ab4e-4610-927e-ba5639b0fc91" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:22:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:38 user nova-compute[71312]: DEBUG nova.objects.instance [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lazy-loading 'flavor' on Instance uuid 6471ba37-ab4e-4610-927e-ba5639b0fc91 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:22:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Ignoring supplied device name: /dev/vdb
Jul 25 10:22:38 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:22:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:38 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:22:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:38 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:39 user nova-compute[71312]: INFO nova.compute.manager [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Attaching volume 820b7e0c-76f4-4f72-99e5-6a7c685d6c30 to /dev/vdb
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG os_brick.utils [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2613234-3a3f-4458-802e-9f1b02880820]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff0a07a-7ab1-4934-8ec9-90e4936ed0e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[26af4597-8c0b-440c-a420-feb4bcf9b7d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6b6985-5a40-49ae-a6eb-cc7bdc3280dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:22:39 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b944640f-d6b0-4e2b-9763-d57852df65a6]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG os_brick.utils [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Updating existing volume attachment record: 5a738d5d-be34-4271-9160-1f8d78664ed6 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:22:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:22:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:22:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8052MB free_disk=25.19671630859375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:22:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:22:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:22:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 6471ba37-ab4e-4610-927e-ba5639b0fc91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:22:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f7858973-7146-4229-9f41-00ebcc7618b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:22:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 82f8117b-e142-48a7-ba13-a697f2603958 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:22:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 411b2cee-bb2d-4b65-921c-3248c1edc454 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:22:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:22:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:22:41 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:22:41 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:22:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:22:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:22:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:22:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPhMxHQg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:22:45 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:22:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:22:45 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:22:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:22:45 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d25013-f941-421e-9743-3fd2fc168388]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:22:45 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a76bfa4-cf6a-4fd2-85ef-b7484f0288dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30] added
Jul 25 10:22:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ec521a-d4fb-41d4-a816-7fb82bfbce2b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a2de51-a24e-436b-b868-666cd72060b6]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPhMxHQg {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPhMxHQg" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc67e8f-564a-4098-9c1a-4325bc466602]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WPhMxHQg'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f536fbf-a7d9-4905-8823-afdc9865099a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c61790f-e131-4da9-8907-a2d2db90af57]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:22:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:22:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:22:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dfe22d-d77f-4fac-be70-0cef1bb42581]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30, portal: 172.16.0.220,3260]
Jul 25 10:22:46 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30, portal: 172.16.0.220,3260] successful.
Jul 25 10:22:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77ff41c-bcfe-4d4c-b141-56fe12c9c735]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[189f0886-b1ff-46b6-9b0d-78dfeb93debe]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:22:46 user nova-compute[71312]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 (non-flash)
Jul 25 10:22:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:22:46 user nova-compute[71312]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 (non-flash)
Jul 25 10:22:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1b7c54-d7af-4564-a998-7f1296df193c]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:22:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPhMxHQg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:22:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:22:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23662666338366339', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:22:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662666338366339', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:22:47 user nova-compute[71312]: DEBUG nova.objects.instance [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lazy-loading 'flavor' on Instance uuid 6471ba37-ab4e-4610-927e-ba5639b0fc91 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:22:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:22:47 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:22:47 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Jul 25 10:22:47 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:22:47 user nova-compute[71312]:   <serial>820b7e0c-76f4-4f72-99e5-6a7c685d6c30</serial>
Jul 25 10:22:47 user nova-compute[71312]: </disk>
Jul 25 10:22:47 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:22:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:22:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:22:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] No VIF found with MAC fa:16:3e:42:7e:64, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:22:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bf4ec883-05b2-430f-b1aa-5f4635fe65b3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.617s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:50 user nova-compute[71312]: INFO nova.compute.manager [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Rescuing
Jul 25 10:22:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:22:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquired lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:22:50 user nova-compute[71312]: DEBUG nova.network.neutron [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:22:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Updating instance_info_cache with network_info: [{"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:22:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Releasing lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:22:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-e40bbc64-87e3-4386-a495-a498d3ea43a8 req-924ba1c9-f1b1-43f6-b5fa-759710ee3660 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-unplugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:22:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e40bbc64-87e3-4386-a495-a498d3ea43a8 req-924ba1c9-f1b1-43f6-b5fa-759710ee3660 service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e40bbc64-87e3-4386-a495-a498d3ea43a8 req-924ba1c9-f1b1-43f6-b5fa-759710ee3660 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e40bbc64-87e3-4386-a495-a498d3ea43a8 req-924ba1c9-f1b1-43f6-b5fa-759710ee3660 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-e40bbc64-87e3-4386-a495-a498d3ea43a8 req-924ba1c9-f1b1-43f6-b5fa-759710ee3660 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-unplugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:22:51 user nova-compute[71312]: WARNING nova.compute.manager [req-e40bbc64-87e3-4386-a495-a498d3ea43a8 req-924ba1c9-f1b1-43f6-b5fa-759710ee3660 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-unplugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state active and task_state rescuing.
Jul 25 10:22:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:52 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Instance destroyed successfully.
Jul 25 10:22:52 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Attempting rescue
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71312) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 10:22:52 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Creating image(s)
Jul 25 10:22:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "/opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "/opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "/opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.rescue {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.rescue" returned: 0 in 0.059s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'migration_context' on Instance uuid 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Start _get_guest_xml network_info=[{"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "vif_mac": "fa:16:3e:65:24:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'resources' on Instance uuid 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'numa_topology' on Instance uuid 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:22:52 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:22:52 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:18:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1913416426',display_name='tempest-ServerRescueNegativeTestJSON-server-1913416426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1913416426',id=36,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:18:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce6203d47944c3cb5bca9ab1c173192',ramdisk_id='',reservation_id='r-oatv27me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1328366493',owner_user_name='tempest-ServerRescueNegativeTestJSON-1328366493-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:18:14Z,user_data=None,user_id='fc43767776ce4c9daf58530d543b0e3f',uuid=68165a49-f7f7-48b2-b7a0-34c09c6e8d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "vif_mac": "fa:16:3e:65:24:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converting VIF {"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "vif_mac": "fa:16:3e:65:24:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:24:56,bridge_name='br-int',has_traffic_filtering=True,id=a2b2a233-ed89-4660-b554-fb9e3260c20f,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b2a233-ed') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'pci_devices' on Instance uuid 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:22:52 user nova-compute[71312]:   <uuid>68165a49-f7f7-48b2-b7a0-34c09c6e8d2f</uuid>
Jul 25 10:22:52 user nova-compute[71312]:   <name>instance-00000024</name>
Jul 25 10:22:52 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:22:52 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:22:52 user nova-compute[71312]:   <metadata>
Jul 25 10:22:52 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:22:52 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:22:52 user nova-compute[71312]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1913416426</nova:name>
Jul 25 10:22:52 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:22:52</nova:creationTime>
Jul 25 10:22:52 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:22:52 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:22:52 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:22:52 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:22:52 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:22:52 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:22:52 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:22:52 user nova-compute[71312]:       <nova:owner>
Jul 25 10:22:52 user nova-compute[71312]:         <nova:user uuid="fc43767776ce4c9daf58530d543b0e3f">tempest-ServerRescueNegativeTestJSON-1328366493-project-member</nova:user>
Jul 25 10:22:52 user nova-compute[71312]:         <nova:project uuid="3ce6203d47944c3cb5bca9ab1c173192">tempest-ServerRescueNegativeTestJSON-1328366493</nova:project>
Jul 25 10:22:52 user nova-compute[71312]:       </nova:owner>
Jul 25 10:22:52 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:22:52 user nova-compute[71312]:       <nova:ports>
Jul 25 10:22:52 user nova-compute[71312]:         <nova:port uuid="a2b2a233-ed89-4660-b554-fb9e3260c20f">
Jul 25 10:22:52 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 10:22:52 user nova-compute[71312]:         </nova:port>
Jul 25 10:22:52 user nova-compute[71312]:       </nova:ports>
Jul 25 10:22:52 user nova-compute[71312]:     </nova:instance>
Jul 25 10:22:52 user nova-compute[71312]:   </metadata>
Jul 25 10:22:52 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:22:52 user nova-compute[71312]:     <system>
Jul 25 10:22:52 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:22:52 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:22:52 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:22:52 user nova-compute[71312]:       <entry name="serial">68165a49-f7f7-48b2-b7a0-34c09c6e8d2f</entry>
Jul 25 10:22:52 user nova-compute[71312]:       <entry name="uuid">68165a49-f7f7-48b2-b7a0-34c09c6e8d2f</entry>
Jul 25 10:22:52 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:22:52 user nova-compute[71312]:     </system>
Jul 25 10:22:52 user nova-compute[71312]:   </sysinfo>
Jul 25 10:22:52 user nova-compute[71312]:   <os>
Jul 25 10:22:52 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:22:52 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:22:52 user nova-compute[71312]:   </os>
Jul 25 10:22:52 user nova-compute[71312]:   <features>
Jul 25 10:22:52 user nova-compute[71312]:     <acpi/>
Jul 25 10:22:52 user nova-compute[71312]:     <apic/>
Jul 25 10:22:52 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:22:52 user nova-compute[71312]:   </features>
Jul 25 10:22:52 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:22:52 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:22:52 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:22:52 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:22:52 user nova-compute[71312]:   </clock>
Jul 25 10:22:52 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:22:52 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:22:52 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:22:52 user nova-compute[71312]:   </cpu>
Jul 25 10:22:52 user nova-compute[71312]:   <devices>
Jul 25 10:22:52 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:22:52 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:22:52 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.rescue"/>
Jul 25 10:22:52 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:22:52 user nova-compute[71312]:     </disk>
Jul 25 10:22:52 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:22:52 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:22:52 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk"/>
Jul 25 10:22:52 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Jul 25 10:22:52 user nova-compute[71312]:     </disk>
Jul 25 10:22:52 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:22:52 user nova-compute[71312]:       <mac address="fa:16:3e:65:24:56"/>
Jul 25 10:22:52 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:22:52 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:22:52 user nova-compute[71312]:       <target dev="tapa2b2a233-ed"/>
Jul 25 10:22:52 user nova-compute[71312]:     </interface>
Jul 25 10:22:52 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:22:52 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/console.log" append="off"/>
Jul 25 10:22:52 user nova-compute[71312]:     </serial>
Jul 25 10:22:52 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:22:52 user nova-compute[71312]:     <video>
Jul 25 10:22:52 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:22:52 user nova-compute[71312]:     </video>
Jul 25 10:22:52 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:22:52 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:22:52 user nova-compute[71312]:     </rng>
Jul 25 10:22:52 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:22:52 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:22:52 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:22:52 user nova-compute[71312]:     </memballoon>
Jul 25 10:22:52 user nova-compute[71312]:   </devices>
Jul 25 10:22:52 user nova-compute[71312]: </domain>
Jul 25 10:22:52 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:22:52 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Instance destroyed successfully.
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No VIF found with MAC fa:16:3e:65:24:56, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:22:53 user nova-compute[71312]: WARNING nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state active and task_state rescuing.
Jul 25 10:22:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:22:53 user nova-compute[71312]: WARNING nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state active and task_state rescuing.
Jul 25 10:22:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:22:53 user nova-compute[71312]: WARNING nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state active and task_state rescuing.
Jul 25 10:22:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-unplugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:22:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-unplugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:22:54 user nova-compute[71312]: WARNING nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-unplugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state active and task_state rescuing.
Jul 25 10:22:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:22:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:22:54 user nova-compute[71312]: WARNING nova.compute.manager [req-daf54cba-908e-4e2e-bb81-febe87617cba req-1736b603-c3c1-42fb-a513-972331541dc7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state active and task_state rescuing.
Jul 25 10:22:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:22:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-794aa66b-6def-4616-bd3d-d8bbc26f2ac6 req-e340f9b4-1463-4a11-9a03-11bb1bd86ece service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:22:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-794aa66b-6def-4616-bd3d-d8bbc26f2ac6 req-e340f9b4-1463-4a11-9a03-11bb1bd86ece service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-794aa66b-6def-4616-bd3d-d8bbc26f2ac6 req-e340f9b4-1463-4a11-9a03-11bb1bd86ece service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-794aa66b-6def-4616-bd3d-d8bbc26f2ac6 req-e340f9b4-1463-4a11-9a03-11bb1bd86ece service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-794aa66b-6def-4616-bd3d-d8bbc26f2ac6 req-e340f9b4-1463-4a11-9a03-11bb1bd86ece service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:22:56 user nova-compute[71312]: WARNING nova.compute.manager [req-794aa66b-6def-4616-bd3d-d8bbc26f2ac6 req-e340f9b4-1463-4a11-9a03-11bb1bd86ece service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state active and task_state rescuing.
Jul 25 10:22:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-794aa66b-6def-4616-bd3d-d8bbc26f2ac6 req-e340f9b4-1463-4a11-9a03-11bb1bd86ece service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:22:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-794aa66b-6def-4616-bd3d-d8bbc26f2ac6 req-e340f9b4-1463-4a11-9a03-11bb1bd86ece service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:22:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-794aa66b-6def-4616-bd3d-d8bbc26f2ac6 req-e340f9b4-1463-4a11-9a03-11bb1bd86ece service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:22:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-794aa66b-6def-4616-bd3d-d8bbc26f2ac6 req-e340f9b4-1463-4a11-9a03-11bb1bd86ece service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:22:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-794aa66b-6def-4616-bd3d-d8bbc26f2ac6 req-e340f9b4-1463-4a11-9a03-11bb1bd86ece service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:22:56 user nova-compute[71312]: WARNING nova.compute.manager [req-794aa66b-6def-4616-bd3d-d8bbc26f2ac6 req-e340f9b4-1463-4a11-9a03-11bb1bd86ece service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state active and task_state rescuing.
Jul 25 10:22:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Removed pending event for 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 10:22:56 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280576.4860673, 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:22:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] VM Resumed (Lifecycle Event)
Jul 25 10:22:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-72622e1d-65ed-4304-a8ef-42a59aa5ab5c tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:22:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:22:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:22:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 10:22:56 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280576.4897194, 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:22:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] VM Started (Lifecycle Event)
Jul 25 10:22:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:22:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:22:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:10 user nova-compute[71312]: INFO nova.compute.manager [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Detaching volume 820b7e0c-76f4-4f72-99e5-6a7c685d6c30
Jul 25 10:23:10 user nova-compute[71312]: INFO nova.virt.block_device [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Attempting to driver detach volume 820b7e0c-76f4-4f72-99e5-6a7c685d6c30 from mountpoint /dev/vdb
Jul 25 10:23:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Attempting to detach device vdb from instance 6471ba37-ab4e-4610-927e-ba5639b0fc91 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:23:10 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:23:10 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Jul 25 10:23:10 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:23:10 user nova-compute[71312]:   <serial>820b7e0c-76f4-4f72-99e5-6a7c685d6c30</serial>
Jul 25 10:23:10 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:23:10 user nova-compute[71312]: </disk>
Jul 25 10:23:10 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:23:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Successfully detached device vdb from instance 6471ba37-ab4e-4610-927e-ba5639b0fc91 from the persistent domain config.
Jul 25 10:23:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6471ba37-ab4e-4610-927e-ba5639b0fc91 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:23:10 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:23:10 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Jul 25 10:23:10 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:23:10 user nova-compute[71312]:   <serial>820b7e0c-76f4-4f72-99e5-6a7c685d6c30</serial>
Jul 25 10:23:10 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:23:10 user nova-compute[71312]: </disk>
Jul 25 10:23:10 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690280590.7809658, 6471ba37-ab4e-4610-927e-ba5639b0fc91 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6471ba37-ab4e-4610-927e-ba5639b0fc91 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:23:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Successfully detached device vdb from instance 6471ba37-ab4e-4610-927e-ba5639b0fc91 from the live domain config.
Jul 25 10:23:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPhMxHQg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:23:10 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:23:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[41745c86-b541-4995-a399-a5ffde88b1cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:23:10 user nova-compute[71312]: No targets found.
Jul 25 10:23:10 user nova-compute[71312]: iSNS:
Jul 25 10:23:10 user nova-compute[71312]: No targets found.
Jul 25 10:23:10 user nova-compute[71312]: STATIC:
Jul 25 10:23:10 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652
Jul 25 10:23:10 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:23:10 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:23:10 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30
Jul 25 10:23:10 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:23:10 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:23:10 user nova-compute[71312]: FIRMWARE:
Jul 25 10:23:10 user nova-compute[71312]: No targets found.
Jul 25 10:23:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:23:10 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:23:10 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9d1aee-04b8-4c02-934a-fd15c0592da6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe1d973-dec0-4562-a8fb-a7a8e8d317b7]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:23:10 user nova-compute[71312]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 (non-flash)
Jul 25 10:23:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:23:10 user nova-compute[71312]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 (non-flash)
Jul 25 10:23:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c0136c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe96143-6097-4482-b7b7-faadc16719e0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[412b3586-ec98-4f2d-ab79-18b569c83617]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[026bb21d-5dc9-43a2-8e46-fbe8e2aba410]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[203824a9-21f1-4932-96e6-bfa00e9a8c8f]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebc24e8-df69-4c57-bdaa-327558253393]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaf7946-3df9-412c-9a05-b41875e6837a]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30, portal: 172.16.0.220,3260]
Jul 25 10:23:11 user nova-compute[71312]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30, portal: 172.16.0.220,3260] successful.
Jul 25 10:23:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7c667a-eb76-408b-8204-b2dc6f0c0196]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] <== disconnect_volume: return (404ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lazy-loading 'flavor' on Instance uuid 6471ba37-ab4e-4610-927e-ba5639b0fc91 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e022cb3-647c-4fb0-af51-11d5e8649c9d tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.693s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.575s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:11 user nova-compute[71312]: INFO nova.compute.manager [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Terminating instance
Jul 25 10:23:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-5d4af81a-7a54-42c6-b987-d37ee650eaaa req-44cdd37a-52a6-4aca-957f-a5c733068ae7 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Received event network-vif-unplugged-7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5d4af81a-7a54-42c6-b987-d37ee650eaaa req-44cdd37a-52a6-4aca-957f-a5c733068ae7 service nova] Acquiring lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5d4af81a-7a54-42c6-b987-d37ee650eaaa req-44cdd37a-52a6-4aca-957f-a5c733068ae7 service nova] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5d4af81a-7a54-42c6-b987-d37ee650eaaa req-44cdd37a-52a6-4aca-957f-a5c733068ae7 service nova] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-5d4af81a-7a54-42c6-b987-d37ee650eaaa req-44cdd37a-52a6-4aca-957f-a5c733068ae7 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] No waiting events found dispatching network-vif-unplugged-7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-5d4af81a-7a54-42c6-b987-d37ee650eaaa req-44cdd37a-52a6-4aca-957f-a5c733068ae7 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Received event network-vif-unplugged-7ddc7200-6a27-491b-834b-101bb1e0b1ba for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Instance destroyed successfully.
Jul 25 10:23:12 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lazy-loading 'resources' on Instance uuid 6471ba37-ab4e-4610-927e-ba5639b0fc91 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1502911764',display_name='tempest-VolumesSnapshotTestJSON-instance-1502911764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1502911764',id=38,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7DvQGMCqexutAdVzSCK7lDyErYDNxgw3ARHtF4ahmxNtasTtZJqROZRwykJ5t8uHOnUMpGSuXEN/9/eGfffkX+mNiEDQzBEavPOPMrngQp8RR1fIWewyfkU9E2ZmjG+g==',key_name='tempest-keypair-537319045',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:20:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef43ca749d7c4576b084ddd6041c4c7f',ramdisk_id='',reservation_id='r-fw4fisb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-458554832',owner_user_name='tempest-VolumesSnapshotTestJSON-458554832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:20:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6f0b54327ff42f389ff059e65014340',uuid=6471ba37-ab4e-4610-927e-ba5639b0fc91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "address": "fa:16:3e:42:7e:64", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddc7200-6a", "ovs_interfaceid": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Converting VIF {"id": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "address": "fa:16:3e:42:7e:64", "network": {"id": "e1775143-19d2-4eab-920b-9f631d2248dd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1735421346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef43ca749d7c4576b084ddd6041c4c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ddc7200-6a", "ovs_interfaceid": "7ddc7200-6a27-491b-834b-101bb1e0b1ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:7e:64,bridge_name='br-int',has_traffic_filtering=True,id=7ddc7200-6a27-491b-834b-101bb1e0b1ba,network=Network(e1775143-19d2-4eab-920b-9f631d2248dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ddc7200-6a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG os_vif [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:7e:64,bridge_name='br-int',has_traffic_filtering=True,id=7ddc7200-6a27-491b-834b-101bb1e0b1ba,network=Network(e1775143-19d2-4eab-920b-9f631d2248dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ddc7200-6a') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ddc7200-6a, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:23:12 user nova-compute[71312]: INFO os_vif [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:7e:64,bridge_name='br-int',has_traffic_filtering=True,id=7ddc7200-6a27-491b-834b-101bb1e0b1ba,network=Network(e1775143-19d2-4eab-920b-9f631d2248dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ddc7200-6a')
Jul 25 10:23:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPhMxHQg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:23:12 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:23:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4711603-d45b-473c-ae94-f0855bf0c9a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:23:12 user nova-compute[71312]: No targets found.
Jul 25 10:23:12 user nova-compute[71312]: iSNS:
Jul 25 10:23:12 user nova-compute[71312]: No targets found.
Jul 25 10:23:12 user nova-compute[71312]: STATIC:
Jul 25 10:23:12 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652
Jul 25 10:23:12 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:23:12 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:23:12 user nova-compute[71312]: FIRMWARE:
Jul 25 10:23:12 user nova-compute[71312]: No targets found.
Jul 25 10:23:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:23:12 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:23:12 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:820b7e0c-76f4-4f72-99e5-6a7c685d6c30', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1044a871-69f8-4f84-a79d-78193127dfd4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1192f15-3ff8-44ef-ab8c-9b62395c8c7c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:23:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:23:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a87f29e0>, {}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Disconnecting from: [] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] <== disconnect_volume: return (71ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:23:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Deleting instance files /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91_del
Jul 25 10:23:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Deletion of /opt/stack/data/nova/instances/6471ba37-ab4e-4610-927e-ba5639b0fc91_del complete
Jul 25 10:23:12 user nova-compute[71312]: INFO nova.compute.manager [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 25 10:23:12 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:23:12 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:23:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-379f5e46-ac9e-431e-9d91-8353e31f9748 req-27a3dc00-6817-404f-8483-78f8dd6c8390 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Received event network-changed-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:23:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-379f5e46-ac9e-431e-9d91-8353e31f9748 req-27a3dc00-6817-404f-8483-78f8dd6c8390 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Refreshing instance network info cache due to event network-changed-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:23:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-379f5e46-ac9e-431e-9d91-8353e31f9748 req-27a3dc00-6817-404f-8483-78f8dd6c8390 service nova] Acquiring lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:23:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-379f5e46-ac9e-431e-9d91-8353e31f9748 req-27a3dc00-6817-404f-8483-78f8dd6c8390 service nova] Acquired lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:23:13 user nova-compute[71312]: DEBUG nova.network.neutron [req-379f5e46-ac9e-431e-9d91-8353e31f9748 req-27a3dc00-6817-404f-8483-78f8dd6c8390 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Refreshing network info cache for port 1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:23:13 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:23:13 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Took 1.08 seconds to deallocate network for instance.
Jul 25 10:23:13 user nova-compute[71312]: WARNING nova.volume.cinder [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Attachment 5a738d5d-be34-4271-9160-1f8d78664ed6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5a738d5d-be34-4271-9160-1f8d78664ed6. (HTTP 404) (Request-ID: req-6224805b-9c00-4c64-85bb-898303e43a42)
Jul 25 10:23:13 user nova-compute[71312]: INFO nova.compute.manager [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Took 0.02 seconds to detach 1 volumes for instance.
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "f7858973-7146-4229-9f41-00ebcc7618b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "f7858973-7146-4229-9f41-00ebcc7618b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-a985151f-81dc-496d-ad2f-7fc2f9b9b331 req-b982ae17-d65f-4ff4-b06c-0a5395a83a08 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Received event network-vif-plugged-7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a985151f-81dc-496d-ad2f-7fc2f9b9b331 req-b982ae17-d65f-4ff4-b06c-0a5395a83a08 service nova] Acquiring lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a985151f-81dc-496d-ad2f-7fc2f9b9b331 req-b982ae17-d65f-4ff4-b06c-0a5395a83a08 service nova] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a985151f-81dc-496d-ad2f-7fc2f9b9b331 req-b982ae17-d65f-4ff4-b06c-0a5395a83a08 service nova] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-a985151f-81dc-496d-ad2f-7fc2f9b9b331 req-b982ae17-d65f-4ff4-b06c-0a5395a83a08 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] No waiting events found dispatching network-vif-plugged-7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:23:14 user nova-compute[71312]: WARNING nova.compute.manager [req-a985151f-81dc-496d-ad2f-7fc2f9b9b331 req-b982ae17-d65f-4ff4-b06c-0a5395a83a08 service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Received unexpected event network-vif-plugged-7ddc7200-6a27-491b-834b-101bb1e0b1ba for instance with vm_state deleted and task_state None.
Jul 25 10:23:14 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lazy-loading 'flavor' on Instance uuid f7858973-7146-4229-9f41-00ebcc7618b4 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:14 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Deleted allocations for instance 6471ba37-ab4e-4610-927e-ba5639b0fc91
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "f7858973-7146-4229-9f41-00ebcc7618b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG nova.network.neutron [req-379f5e46-ac9e-431e-9d91-8353e31f9748 req-27a3dc00-6817-404f-8483-78f8dd6c8390 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Updated VIF entry in instance network info cache for port 1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG nova.network.neutron [req-379f5e46-ac9e-431e-9d91-8353e31f9748 req-27a3dc00-6817-404f-8483-78f8dd6c8390 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Updating instance_info_cache with network_info: [{"id": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "address": "fa:16:3e:54:ae:25", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0efcfa-7e", "ovs_interfaceid": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-379f5e46-ac9e-431e-9d91-8353e31f9748 req-27a3dc00-6817-404f-8483-78f8dd6c8390 service nova] Releasing lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7bd7272-55a4-4287-966d-f21b7e17cab3 tempest-VolumesSnapshotTestJSON-458554832 tempest-VolumesSnapshotTestJSON-458554832-project-member] Lock "6471ba37-ab4e-4610-927e-ba5639b0fc91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.503s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "f7858973-7146-4229-9f41-00ebcc7618b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "f7858973-7146-4229-9f41-00ebcc7618b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:14 user nova-compute[71312]: INFO nova.compute.manager [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Attaching volume 8c9c5d86-540f-4430-bc76-bc4f7074a954 to /dev/vdb
Jul 25 10:23:14 user nova-compute[71312]: DEBUG os_brick.utils [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4532055-3d23-4e56-9b8d-c2674b4e64ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b503efc8-de33-4acf-b71d-cb92e5ec1c0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[368b94e6-8285-4ca6-8bba-bcf701316509]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ed67d2-e36d-437a-8d04-30afacfc94dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:23:14 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:23:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2caaae0-8e17-46ea-9370-1a6773954324]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG os_brick.utils [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:23:14 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Updating existing volume attachment record: 5c0440d5-401c-4fa8-8bad-918dd4ebcfa4 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:23:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-f1e88f1c-68f4-4b15-9e2e-842a4dba9b71 req-95d37db1-e841-4a6e-9b99-a0d85502a3ea service nova] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Received event network-vif-deleted-7ddc7200-6a27-491b-834b-101bb1e0b1ba {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:23:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmOTsSdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:23:21 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:23:21 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:23:21 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8076c955-acd6-4428-b316-4fde50d8749c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:23:21 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efce25a-6927-4671-9dad-e2aaec43c755]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954] added
Jul 25 10:23:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b41b492-aaf6-4ee9-9a37-e96298c84dae]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea9c3a3-b468-41dc-b5f0-6ffff98840d4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmOTsSdo {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmOTsSdo" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3023719-9da0-4024-9116-ed1c503971b0]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gmOTsSdo'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1417867c-b709-412c-ae5d-6d239ff047ca]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d79c0c2-b7cd-495d-b54e-9aa0000b674a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:23:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:23:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6887b18-f02e-49fd-8189-c2f5bf67235a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954, portal: 172.16.0.220,3260]
Jul 25 10:23:21 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954, portal: 172.16.0.220,3260] successful.
Jul 25 10:23:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e3c1c5-154a-4701-b3ed-381c27cf7c76]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9868413d-830c-43fa-a170-6af87031b29f]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:23:21 user nova-compute[71312]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 (non-flash)
Jul 25 10:23:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:23:21 user nova-compute[71312]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 (non-flash)
Jul 25 10:23:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b6c255-8165-4145-a47e-579831aafca4]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:23:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmOTsSdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:23:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:23:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26464396261356362', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:23:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464396261356362', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:23:22 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lazy-loading 'flavor' on Instance uuid f7858973-7146-4229-9f41-00ebcc7618b4 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:23:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:23:22 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:23:22 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Jul 25 10:23:22 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:23:22 user nova-compute[71312]:   <serial>8c9c5d86-540f-4430-bc76-bc4f7074a954</serial>
Jul 25 10:23:22 user nova-compute[71312]: </disk>
Jul 25 10:23:22 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:23:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:23:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:23:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] No VIF found with MAC fa:16:3e:54:ae:25, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:23:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fb49f8f-dac0-437f-a35e-de96b6edc8b2 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "f7858973-7146-4229-9f41-00ebcc7618b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.466s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "f7858973-7146-4229-9f41-00ebcc7618b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "f7858973-7146-4229-9f41-00ebcc7618b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:24 user nova-compute[71312]: INFO nova.compute.manager [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Detaching volume 8c9c5d86-540f-4430-bc76-bc4f7074a954
Jul 25 10:23:24 user nova-compute[71312]: INFO nova.virt.block_device [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Attempting to driver detach volume 8c9c5d86-540f-4430-bc76-bc4f7074a954 from mountpoint /dev/vdb
Jul 25 10:23:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Attempting to detach device vdb from instance f7858973-7146-4229-9f41-00ebcc7618b4 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:23:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:23:24 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:23:24 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Jul 25 10:23:24 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:23:24 user nova-compute[71312]:   <serial>8c9c5d86-540f-4430-bc76-bc4f7074a954</serial>
Jul 25 10:23:24 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:23:24 user nova-compute[71312]: </disk>
Jul 25 10:23:24 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:23:24 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Successfully detached device vdb from instance f7858973-7146-4229-9f41-00ebcc7618b4 from the persistent domain config.
Jul 25 10:23:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7858973-7146-4229-9f41-00ebcc7618b4 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:23:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:23:24 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:23:24 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Jul 25 10:23:24 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:23:24 user nova-compute[71312]:   <serial>8c9c5d86-540f-4430-bc76-bc4f7074a954</serial>
Jul 25 10:23:24 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:23:24 user nova-compute[71312]: </disk>
Jul 25 10:23:24 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690280605.1235309, f7858973-7146-4229-9f41-00ebcc7618b4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7858973-7146-4229-9f41-00ebcc7618b4 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:23:25 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Successfully detached device vdb from instance f7858973-7146-4229-9f41-00ebcc7618b4 from the live domain config.
Jul 25 10:23:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmOTsSdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:23:25 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a057fa57-39fd-4015-8d73-74b04855cc9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:23:25 user nova-compute[71312]: No targets found.
Jul 25 10:23:25 user nova-compute[71312]: iSNS:
Jul 25 10:23:25 user nova-compute[71312]: No targets found.
Jul 25 10:23:25 user nova-compute[71312]: STATIC:
Jul 25 10:23:25 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954
Jul 25 10:23:25 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:23:25 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:23:25 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652
Jul 25 10:23:25 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:23:25 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:23:25 user nova-compute[71312]: FIRMWARE:
Jul 25 10:23:25 user nova-compute[71312]: No targets found.
Jul 25 10:23:25 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:23:25 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:23:25 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3a2be2-4ab4-47c0-9422-36c85897eec4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[33278339-220c-4981-85a2-820646d914d6]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:23:25 user nova-compute[71312]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 (non-flash)
Jul 25 10:23:25 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:23:25 user nova-compute[71312]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 (non-flash)
Jul 25 10:23:25 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9ceec45e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c112816-8b81-40bd-a1ce-0133cadb1e5b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc2f474-9597-4d8b-8fe9-bc888a827d8c]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5cc082-f8b0-4046-bb7f-7b56e9339ca4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.086s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[efba7670-0973-4843-8e2f-275a6f31e0fb]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[926999c5-e440-48ac-893f-c29a0aafa5fb]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b053f5-8dd5-4398-aef2-686c875007dc]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954, portal: 172.16.0.220,3260]
Jul 25 10:23:25 user nova-compute[71312]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954, portal: 172.16.0.220,3260] successful.
Jul 25 10:23:25 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9c5d86-540f-4430-bc76-bc4f7074a954 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e6c193-5493-42e5-b308-5a97713587a8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] <== disconnect_volume: return (347ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:23:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:23:26 user nova-compute[71312]: DEBUG nova.objects.instance [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lazy-loading 'flavor' on Instance uuid f7858973-7146-4229-9f41-00ebcc7618b4 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:23:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-569153fa-32c4-49e4-8b4c-21d904945afb tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "f7858973-7146-4229-9f41-00ebcc7618b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.659s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:27 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280592.7032301, 6471ba37-ab4e-4610-927e-ba5639b0fc91 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:23:27 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] VM Stopped (Lifecycle Event)
Jul 25 10:23:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4097accf-5d15-45a4-a802-82799b2cf8da None None] [instance: 6471ba37-ab4e-4610-927e-ba5639b0fc91] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:23:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:23:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:23:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 10:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:23:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:23:31 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lazy-loading 'info_cache' on Instance uuid 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:23:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Updating instance_info_cache with network_info: [{"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:23:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:23:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:23:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:23:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:23:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:23:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "82f8117b-e142-48a7-ba13-a697f2603958" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "82f8117b-e142-48a7-ba13-a697f2603958" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "82f8117b-e142-48a7-ba13-a697f2603958-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "82f8117b-e142-48a7-ba13-a697f2603958-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "82f8117b-e142-48a7-ba13-a697f2603958-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:34 user nova-compute[71312]: INFO nova.compute.manager [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Terminating instance
Jul 25 10:23:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-29617f57-bad3-45b0-bbc8-92e092bc7889 req-63582c47-4ef5-425d-bb4a-984750a8eec9 service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Received event network-vif-unplugged-f4e3d280-9577-4007-9e9b-33a3fe19d521 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-29617f57-bad3-45b0-bbc8-92e092bc7889 req-63582c47-4ef5-425d-bb4a-984750a8eec9 service nova] Acquiring lock "82f8117b-e142-48a7-ba13-a697f2603958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-29617f57-bad3-45b0-bbc8-92e092bc7889 req-63582c47-4ef5-425d-bb4a-984750a8eec9 service nova] Lock "82f8117b-e142-48a7-ba13-a697f2603958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-29617f57-bad3-45b0-bbc8-92e092bc7889 req-63582c47-4ef5-425d-bb4a-984750a8eec9 service nova] Lock "82f8117b-e142-48a7-ba13-a697f2603958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-29617f57-bad3-45b0-bbc8-92e092bc7889 req-63582c47-4ef5-425d-bb4a-984750a8eec9 service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] No waiting events found dispatching network-vif-unplugged-f4e3d280-9577-4007-9e9b-33a3fe19d521 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-29617f57-bad3-45b0-bbc8-92e092bc7889 req-63582c47-4ef5-425d-bb4a-984750a8eec9 service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Received event network-vif-unplugged-f4e3d280-9577-4007-9e9b-33a3fe19d521 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:23:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Instance destroyed successfully.
Jul 25 10:23:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lazy-loading 'resources' on Instance uuid 82f8117b-e142-48a7-ba13-a697f2603958 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1368570295',display_name='tempest-TestVolumeBootPattern-server-1368570295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1368570295',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:22:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-30q7o7du',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:22:03Z,user_data=None,user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=82f8117b-e142-48a7-ba13-a697f2603958,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "address": "fa:16:3e:1e:4e:d6", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e3d280-95", "ovs_interfaceid": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "address": "fa:16:3e:1e:4e:d6", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e3d280-95", "ovs_interfaceid": "f4e3d280-9577-4007-9e9b-33a3fe19d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f4e3d280-9577-4007-9e9b-33a3fe19d521,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e3d280-95') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_vif [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f4e3d280-9577-4007-9e9b-33a3fe19d521,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e3d280-95') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4e3d280-95, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:23:35 user nova-compute[71312]: INFO os_vif [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f4e3d280-9577-4007-9e9b-33a3fe19d521,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e3d280-95')
Jul 25 10:23:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbqUnAzK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:23:35 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b76c3b2-9261-4e06-83ed-500cbc35cf49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:23:35 user nova-compute[71312]: No targets found.
Jul 25 10:23:35 user nova-compute[71312]: iSNS:
Jul 25 10:23:35 user nova-compute[71312]: No targets found.
Jul 25 10:23:35 user nova-compute[71312]: STATIC:
Jul 25 10:23:35 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652
Jul 25 10:23:35 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:23:35 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:23:35 user nova-compute[71312]: FIRMWARE:
Jul 25 10:23:35 user nova-compute[71312]: No targets found.
Jul 25 10:23:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:23:35 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:23:35 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5b6849-1019-4066-a4e2-9b27211f2285]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f3e51b-f414-40f8-a361-567421a8e344]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:23:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 (non-flash)
Jul 25 10:23:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a82f1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[37182957-ad90-4ddb-b42b-4cbf63d23a69]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6b3521-15d3-41b4-a839-01db458ebc12]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9409ad3-adac-4333-93e2-2be3642d622b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f60ea9-715c-4a4a-b775-3a0f3b6a9e2f]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[583af1f8-a972-4fd8-bbfb-684ce8d732d4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fffad0e-c61c-4c2e-bfaf-8503809931a9]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652, portal: 172.16.0.220,3260]
Jul 25 10:23:36 user nova-compute[71312]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652, portal: 172.16.0.220,3260] successful.
Jul 25 10:23:36 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb741f4f-5892-4a16-bd0c-469c6bd39652 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38538ac-648e-4c1b-abce-3f632f517a79]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:23:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:23:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:23:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== disconnect_volume: return (314ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:23:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:23:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Deleting instance files /opt/stack/data/nova/instances/82f8117b-e142-48a7-ba13-a697f2603958_del
Jul 25 10:23:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Deletion of /opt/stack/data/nova/instances/82f8117b-e142-48a7-ba13-a697f2603958_del complete
Jul 25 10:23:36 user nova-compute[71312]: INFO nova.compute.manager [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Took 1.15 seconds to destroy the instance on the hypervisor.
Jul 25 10:23:36 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:23:36 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:23:36 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:23:36 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:23:36 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Took 0.45 seconds to deallocate network for instance.
Jul 25 10:23:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-39b94a50-793c-4aa3-bc9d-6ef1b785c8b8 req-d80079fa-1f68-4260-aa1f-cb0fdd89bda6 service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Received event network-vif-deleted-f4e3d280-9577-4007-9e9b-33a3fe19d521 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:23:36 user nova-compute[71312]: INFO nova.compute.manager [req-39b94a50-793c-4aa3-bc9d-6ef1b785c8b8 req-d80079fa-1f68-4260-aa1f-cb0fdd89bda6 service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Neutron deleted interface f4e3d280-9577-4007-9e9b-33a3fe19d521; detaching it from the instance and deleting it from the info cache
Jul 25 10:23:36 user nova-compute[71312]: DEBUG nova.network.neutron [req-39b94a50-793c-4aa3-bc9d-6ef1b785c8b8 req-d80079fa-1f68-4260-aa1f-cb0fdd89bda6 service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:23:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-39b94a50-793c-4aa3-bc9d-6ef1b785c8b8 req-d80079fa-1f68-4260-aa1f-cb0fdd89bda6 service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Detach interface failed, port_id=f4e3d280-9577-4007-9e9b-33a3fe19d521, reason: Instance 82f8117b-e142-48a7-ba13-a697f2603958 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:23:37 user nova-compute[71312]: INFO nova.compute.manager [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Took 0.70 seconds to detach 1 volumes for instance.
Jul 25 10:23:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Deleting volume: bb741f4f-5892-4a16-bd0c-469c6bd39652 {{(pid=71312) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 10:23:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-d92e5c30-5f97-49db-9f47-cbdf7616b665 req-4a5557c7-6bd6-48c6-abf2-351d14502b4d service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Received event network-vif-plugged-f4e3d280-9577-4007-9e9b-33a3fe19d521 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:23:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d92e5c30-5f97-49db-9f47-cbdf7616b665 req-4a5557c7-6bd6-48c6-abf2-351d14502b4d service nova] Acquiring lock "82f8117b-e142-48a7-ba13-a697f2603958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d92e5c30-5f97-49db-9f47-cbdf7616b665 req-4a5557c7-6bd6-48c6-abf2-351d14502b4d service nova] Lock "82f8117b-e142-48a7-ba13-a697f2603958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d92e5c30-5f97-49db-9f47-cbdf7616b665 req-4a5557c7-6bd6-48c6-abf2-351d14502b4d service nova] Lock "82f8117b-e142-48a7-ba13-a697f2603958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-d92e5c30-5f97-49db-9f47-cbdf7616b665 req-4a5557c7-6bd6-48c6-abf2-351d14502b4d service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] No waiting events found dispatching network-vif-plugged-f4e3d280-9577-4007-9e9b-33a3fe19d521 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:23:37 user nova-compute[71312]: WARNING nova.compute.manager [req-d92e5c30-5f97-49db-9f47-cbdf7616b665 req-4a5557c7-6bd6-48c6-abf2-351d14502b4d service nova] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Received unexpected event network-vif-plugged-f4e3d280-9577-4007-9e9b-33a3fe19d521 for instance with vm_state active and task_state deleting.
Jul 25 10:23:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:37 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:23:37 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:23:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:37 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Deleted allocations for instance 82f8117b-e142-48a7-ba13-a697f2603958
Jul 25 10:23:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e8dfa79d-2642-4670-966c-c802f647943c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "82f8117b-e142-48a7-ba13-a697f2603958" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.831s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:23:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:23:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:23:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:23:42 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:23:42 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:23:42 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8253MB free_disk=25.177841186523438GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:23:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:23:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:23:42 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:23:42 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:23:42 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f7858973-7146-4229-9f41-00ebcc7618b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:23:42 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 411b2cee-bb2d-4b65-921c-3248c1edc454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:23:42 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:23:42 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:23:42 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:23:42 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:23:42 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:23:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:23:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:23:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:23:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:23:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:50 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280615.676379, 82f8117b-e142-48a7-ba13-a697f2603958 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:23:50 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] VM Stopped (Lifecycle Event)
Jul 25 10:23:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e91ab96-cf31-4291-98bd-1d5384dd1f65 None None] [instance: 82f8117b-e142-48a7-ba13-a697f2603958] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:23:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:23:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:23:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:23:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:23:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:23:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:24:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:24:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:24:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:24:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:24:20 user nova-compute[71312]: INFO nova.compute.manager [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] instance snapshotting
Jul 25 10:24:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Beginning live snapshot process
Jul 25 10:24:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvknpfzyg/5e479e6648ad49068456fe217e9fef1c.delta 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvknpfzyg/5e479e6648ad49068456fe217e9fef1c.delta 1073741824" returned: 0 in 0.070s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 25 10:24:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'flavor' on Instance uuid 411b2cee-bb2d-4b65-921c-3248c1edc454 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:24:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:24:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:21 user nova-compute[71312]: INFO nova.compute.manager [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Attaching volume c3968fd3-3a2f-441c-aa7d-22623ad4240b to /dev/vdb
Jul 25 10:24:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] COPY block job progress, current cursor: 26935296 final cursor: 75563008 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG os_brick.utils [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca1ac12-fe90-4153-a542-44de27e7d9d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6854cf-12c7-47f9-9c28-d7ec77082d84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9444699b-b3e5-4bc2-8c47-0a9229deaadd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[607b219d-9f4d-4b5b-b15c-648343e0491d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:24:22 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc9a4c1-2ffc-4f43-aec4-988a3ca06c5d]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG os_brick.utils [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updating existing volume attachment record: 852ed70b-b113-4dad-94e5-e138b0190271 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 10:24:22 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 25 10:24:22 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:24:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvknpfzyg/5e479e6648ad49068456fe217e9fef1c.delta /opt/stack/data/nova/instances/snapshots/tmpvknpfzyg/5e479e6648ad49068456fe217e9fef1c {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvknpfzyg/5e479e6648ad49068456fe217e9fef1c.delta /opt/stack/data/nova/instances/snapshots/tmpvknpfzyg/5e479e6648ad49068456fe217e9fef1c" returned: 0 in 0.636s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Snapshot extracted, beginning image upload
Jul 25 10:24:25 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Snapshot image upload complete
Jul 25 10:24:25 user nova-compute[71312]: INFO nova.compute.manager [None req-aae2cbfd-5bb9-4475-af66-ea2a800519f5 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Took 5.50 seconds to snapshot the instance on the hypervisor.
Jul 25 10:24:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:24:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:24:29 user nova-compute[71312]: INFO nova.compute.claims [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Claim successful on node user
Jul 25 10:24:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TExdpjmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:24:29 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:24:29 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:24:29 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf969b2-2ef8-4bda-b4db-f26f1f4cbac6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:24:29 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e78e5eb-7cb6-43bf-af55-faa47a86edfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b] added
Jul 25 10:24:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d3b541-f3f6-42c7-a1ef-dc2effb08f87]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.145s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c657c099-4588-4be2-b5c1-6d14ff7d1065]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TExdpjmF {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TExdpjmF" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b8d1cf-8ce3-45dd-addd-f87202cb3dc0]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TExdpjmF'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c09188-bc51-4c8e-aff4-a8f8be12dd5c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[579ea72d-6427-4ddf-91d4-3bee064b7025]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 10:24:29 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 10:24:29 user nova-compute[71312]:  {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:24:29 user nova-compute[71312]: WARNING os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 10:24:29 user nova-compute[71312]: 
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1468622-e09e-46e2-9a02-f723d0b1d003]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260]
Jul 25 10:24:29 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260] successful.
Jul 25 10:24:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b10e0a-b3f2-492d-974b-1a2426cf5535]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[84834bb2-37ae-47ae-b503-c3f8635fe573]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:24:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:24:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a95c070-387d-49dd-af2e-fd88d9b3d0b8]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TExdpjmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG nova.policy [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cca4cdd12f543a2a5864f8a36f56cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfc3cefb0ef4063b439dcbd676372de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:24:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Creating image(s)
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "/opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "/opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "17cc90b74add940c5ba4cfebba463c16b482d999" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "17cc90b74add940c5ba4cfebba463c16b482d999" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.892s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] <== connect_volume: return (1895ms) {'type': 'block', 'scsi_wwn': '26332396162333166', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332396162333166', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Successfully created port: b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'flavor' on Instance uuid 411b2cee-bb2d-4b65-921c-3248c1edc454 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:24:31 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:24:31 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Jul 25 10:24:31 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:24:31 user nova-compute[71312]:   <serial>c3968fd3-3a2f-441c-aa7d-22623ad4240b</serial>
Jul 25 10:24:31 user nova-compute[71312]: </disk>
Jul 25 10:24:31 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999.part --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG nova.virt.images [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] 1dc25d41-41e8-4a66-8610-299ef9f438e3 was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999.part /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] No VIF found with MAC fa:16:3e:61:42:1f, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:24:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999.part /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999.converted" returned: 0 in 0.806s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1e626003-04e5-43c8-81f2-df988d52c7b6 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.122s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Successfully updated port: b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "refresh_cache-9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquired lock "refresh_cache-9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "17cc90b74add940c5ba4cfebba463c16b482d999" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.350s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-d5b57374-aef8-4f84-a353-f866306f104b req-fe76f075-33f2-4721-81ce-8d082d9dd63a service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Received event network-changed-b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-d5b57374-aef8-4f84-a353-f866306f104b req-fe76f075-33f2-4721-81ce-8d082d9dd63a service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Refreshing instance network info cache due to event network-changed-b53e70b3-cc1f-457c-a38b-a984e733116e. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d5b57374-aef8-4f84-a353-f866306f104b req-fe76f075-33f2-4721-81ce-8d082d9dd63a service nova] Acquiring lock "refresh_cache-9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999 --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "17cc90b74add940c5ba4cfebba463c16b482d999" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "17cc90b74add940c5ba4cfebba463c16b482d999" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999 --force-share --output=json" returned: 0 in 0.149s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999,backing_fmt=raw /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999,backing_fmt=raw /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk 1073741824" returned: 0 in 0.053s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "17cc90b74add940c5ba4cfebba463c16b482d999" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Updating instance_info_cache with network_info: [{"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Updating instance_info_cache with network_info: [{"id": "b53e70b3-cc1f-457c-a38b-a984e733116e", "address": "fa:16:3e:e0:f9:ce", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53e70b3-cc", "ovs_interfaceid": "b53e70b3-cc1f-457c-a38b-a984e733116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Releasing lock "refresh_cache-9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Instance network_info: |[{"id": "b53e70b3-cc1f-457c-a38b-a984e733116e", "address": "fa:16:3e:e0:f9:ce", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53e70b3-cc", "ovs_interfaceid": "b53e70b3-cc1f-457c-a38b-a984e733116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d5b57374-aef8-4f84-a353-f866306f104b req-fe76f075-33f2-4721-81ce-8d082d9dd63a service nova] Acquired lock "refresh_cache-9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.network.neutron [req-d5b57374-aef8-4f84-a353-f866306f104b req-fe76f075-33f2-4721-81ce-8d082d9dd63a service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Refreshing network info cache for port b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999 --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lazy-loading 'migration_context' on Instance uuid 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Ensure instance console log exists: /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Start _get_guest_xml network_info=[{"id": "b53e70b3-cc1f-457c-a38b-a984e733116e", "address": "fa:16:3e:e0:f9:ce", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53e70b3-cc", "ovs_interfaceid": "b53e70b3-cc1f-457c-a38b-a984e733116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0ff83f5f55419d7d5f5bba78e4a43cfa',container_format='bare',created_at=2023-07-25T10:24:20Z,direct_url=<?>,disk_format='qcow2',id=1dc25d41-41e8-4a66-8610-299ef9f438e3,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-967880605',owner='1bfc3cefb0ef4063b439dcbd676372de',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-25T10:24:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1dc25d41-41e8-4a66-8610-299ef9f438e3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:24:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:24:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0ff83f5f55419d7d5f5bba78e4a43cfa',container_format='bare',created_at=2023-07-25T10:24:20Z,direct_url=<?>,disk_format='qcow2',id=1dc25d41-41e8-4a66-8610-299ef9f438e3,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-967880605',owner='1bfc3cefb0ef4063b439dcbd676372de',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-25T10:24:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-264739796',display_name='tempest-TestStampPattern-server-264739796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-264739796',id=42,image_ref='1dc25d41-41e8-4a66-8610-299ef9f438e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO1P3w5txB81eBV0yGtov3Oc4MCOl8jqxiKKGPa9B1SJkwnNnhcpWHBgFyyPz0VqYDAtprnCkjl1yxKxNR+/1Pg+zuU7SSaxI20iqUoduPzUQp894ipIxOppnDgCxC0Mw==',key_name='tempest-TestStampPattern-764832787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bfc3cefb0ef4063b439dcbd676372de',ramdisk_id='',reservation_id='r-u4i6ekdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f7858973-7146-4229-9f41-00ebcc7618b4',image_min_disk='1',image_min_ram='0',image_owner_id='1bfc3cefb0ef4063b439dcbd676372de',image_owner_project_name='tempest-TestStampPattern-1852512142',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1852512142-project-member',image_user_id='0cca4cdd12f543a2a5864f8a36f56cb4',network_allocated='True',owner_project_name='tempest-TestStampPattern-1852512142',owner_user_name='tempest-TestStampPattern-1852512142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:24:30Z,user_data=None,user_id='0cca4cdd12f543a2a5864f8a36f56cb4',uuid=9c2097e9-6079-4ccc-9ca5-5fcfd035d61b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b53e70b3-cc1f-457c-a38b-a984e733116e", "address": "fa:16:3e:e0:f9:ce", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53e70b3-cc", "ovs_interfaceid": "b53e70b3-cc1f-457c-a38b-a984e733116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Converting VIF {"id": "b53e70b3-cc1f-457c-a38b-a984e733116e", "address": "fa:16:3e:e0:f9:ce", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53e70b3-cc", "ovs_interfaceid": "b53e70b3-cc1f-457c-a38b-a984e733116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:f9:ce,bridge_name='br-int',has_traffic_filtering=True,id=b53e70b3-cc1f-457c-a38b-a984e733116e,network=Network(500d3ecb-db5e-4d97-abcc-16264ba81220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53e70b3-cc') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:24:32 user nova-compute[71312]:   <uuid>9c2097e9-6079-4ccc-9ca5-5fcfd035d61b</uuid>
Jul 25 10:24:32 user nova-compute[71312]:   <name>instance-0000002a</name>
Jul 25 10:24:32 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:24:32 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:24:32 user nova-compute[71312]:   <metadata>
Jul 25 10:24:32 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:24:32 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:24:32 user nova-compute[71312]:       <nova:name>tempest-TestStampPattern-server-264739796</nova:name>
Jul 25 10:24:32 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:24:32</nova:creationTime>
Jul 25 10:24:32 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:24:32 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:24:32 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:24:32 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:24:32 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:24:32 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:24:32 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:24:32 user nova-compute[71312]:       <nova:owner>
Jul 25 10:24:32 user nova-compute[71312]:         <nova:user uuid="0cca4cdd12f543a2a5864f8a36f56cb4">tempest-TestStampPattern-1852512142-project-member</nova:user>
Jul 25 10:24:32 user nova-compute[71312]:         <nova:project uuid="1bfc3cefb0ef4063b439dcbd676372de">tempest-TestStampPattern-1852512142</nova:project>
Jul 25 10:24:32 user nova-compute[71312]:       </nova:owner>
Jul 25 10:24:32 user nova-compute[71312]:       <nova:root type="image" uuid="1dc25d41-41e8-4a66-8610-299ef9f438e3"/>
Jul 25 10:24:32 user nova-compute[71312]:       <nova:ports>
Jul 25 10:24:32 user nova-compute[71312]:         <nova:port uuid="b53e70b3-cc1f-457c-a38b-a984e733116e">
Jul 25 10:24:32 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 10:24:32 user nova-compute[71312]:         </nova:port>
Jul 25 10:24:32 user nova-compute[71312]:       </nova:ports>
Jul 25 10:24:32 user nova-compute[71312]:     </nova:instance>
Jul 25 10:24:32 user nova-compute[71312]:   </metadata>
Jul 25 10:24:32 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:24:32 user nova-compute[71312]:     <system>
Jul 25 10:24:32 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:24:32 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:24:32 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:24:32 user nova-compute[71312]:       <entry name="serial">9c2097e9-6079-4ccc-9ca5-5fcfd035d61b</entry>
Jul 25 10:24:32 user nova-compute[71312]:       <entry name="uuid">9c2097e9-6079-4ccc-9ca5-5fcfd035d61b</entry>
Jul 25 10:24:32 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:24:32 user nova-compute[71312]:     </system>
Jul 25 10:24:32 user nova-compute[71312]:   </sysinfo>
Jul 25 10:24:32 user nova-compute[71312]:   <os>
Jul 25 10:24:32 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:24:32 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:24:32 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:24:32 user nova-compute[71312]:   </os>
Jul 25 10:24:32 user nova-compute[71312]:   <features>
Jul 25 10:24:32 user nova-compute[71312]:     <acpi/>
Jul 25 10:24:32 user nova-compute[71312]:     <apic/>
Jul 25 10:24:32 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:24:32 user nova-compute[71312]:   </features>
Jul 25 10:24:32 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:24:32 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:24:32 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:24:32 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:24:32 user nova-compute[71312]:   </clock>
Jul 25 10:24:32 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:24:32 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:24:32 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:24:32 user nova-compute[71312]:   </cpu>
Jul 25 10:24:32 user nova-compute[71312]:   <devices>
Jul 25 10:24:32 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:24:32 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:24:32 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk"/>
Jul 25 10:24:32 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:24:32 user nova-compute[71312]:     </disk>
Jul 25 10:24:32 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:24:32 user nova-compute[71312]:       <mac address="fa:16:3e:e0:f9:ce"/>
Jul 25 10:24:32 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:24:32 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:24:32 user nova-compute[71312]:       <target dev="tapb53e70b3-cc"/>
Jul 25 10:24:32 user nova-compute[71312]:     </interface>
Jul 25 10:24:32 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:24:32 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/console.log" append="off"/>
Jul 25 10:24:32 user nova-compute[71312]:     </serial>
Jul 25 10:24:32 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:24:32 user nova-compute[71312]:     <video>
Jul 25 10:24:32 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:24:32 user nova-compute[71312]:     </video>
Jul 25 10:24:32 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:24:32 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:24:32 user nova-compute[71312]:     </rng>
Jul 25 10:24:32 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:24:32 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:24:32 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:24:32 user nova-compute[71312]:     </memballoon>
Jul 25 10:24:32 user nova-compute[71312]:   </devices>
Jul 25 10:24:32 user nova-compute[71312]: </domain>
Jul 25 10:24:32 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-264739796',display_name='tempest-TestStampPattern-server-264739796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-264739796',id=42,image_ref='1dc25d41-41e8-4a66-8610-299ef9f438e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO1P3w5txB81eBV0yGtov3Oc4MCOl8jqxiKKGPa9B1SJkwnNnhcpWHBgFyyPz0VqYDAtprnCkjl1yxKxNR+/1Pg+zuU7SSaxI20iqUoduPzUQp894ipIxOppnDgCxC0Mw==',key_name='tempest-TestStampPattern-764832787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bfc3cefb0ef4063b439dcbd676372de',ramdisk_id='',reservation_id='r-u4i6ekdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f7858973-7146-4229-9f41-00ebcc7618b4',image_min_disk='1',image_min_ram='0',image_owner_id='1bfc3cefb0ef4063b439dcbd676372de',image_owner_project_name='tempest-TestStampPattern-1852512142',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1852512142-project-member',image_user_id='0cca4cdd12f543a2a5864f8a36f56cb4',network_allocated='True',owner_project_name='tempest-TestStampPattern-1852512142',owner_user_name='tempest-TestStampPattern-1852512142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:24:30Z,user_data=None,user_id='0cca4cdd12f543a2a5864f8a36f56cb4',uuid=9c2097e9-6079-4ccc-9ca5-5fcfd035d61b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b53e70b3-cc1f-457c-a38b-a984e733116e", "address": "fa:16:3e:e0:f9:ce", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53e70b3-cc", "ovs_interfaceid": "b53e70b3-cc1f-457c-a38b-a984e733116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Converting VIF {"id": "b53e70b3-cc1f-457c-a38b-a984e733116e", "address": "fa:16:3e:e0:f9:ce", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53e70b3-cc", "ovs_interfaceid": "b53e70b3-cc1f-457c-a38b-a984e733116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:f9:ce,bridge_name='br-int',has_traffic_filtering=True,id=b53e70b3-cc1f-457c-a38b-a984e733116e,network=Network(500d3ecb-db5e-4d97-abcc-16264ba81220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53e70b3-cc') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG os_vif [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:f9:ce,bridge_name='br-int',has_traffic_filtering=True,id=b53e70b3-cc1f-457c-a38b-a984e733116e,network=Network(500d3ecb-db5e-4d97-abcc-16264ba81220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53e70b3-cc') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb53e70b3-cc, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb53e70b3-cc, col_values=(('external_ids', {'iface-id': 'b53e70b3-cc1f-457c-a38b-a984e733116e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:f9:ce', 'vm-uuid': '9c2097e9-6079-4ccc-9ca5-5fcfd035d61b'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:32 user nova-compute[71312]: INFO os_vif [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:f9:ce,bridge_name='br-int',has_traffic_filtering=True,id=b53e70b3-cc1f-457c-a38b-a984e733116e,network=Network(500d3ecb-db5e-4d97-abcc-16264ba81220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53e70b3-cc')
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:24:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] No VIF found with MAC fa:16:3e:e0:f9:ce, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:24:33 user nova-compute[71312]: DEBUG nova.network.neutron [req-d5b57374-aef8-4f84-a353-f866306f104b req-fe76f075-33f2-4721-81ce-8d082d9dd63a service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Updated VIF entry in instance network info cache for port b53e70b3-cc1f-457c-a38b-a984e733116e. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:24:33 user nova-compute[71312]: DEBUG nova.network.neutron [req-d5b57374-aef8-4f84-a353-f866306f104b req-fe76f075-33f2-4721-81ce-8d082d9dd63a service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Updating instance_info_cache with network_info: [{"id": "b53e70b3-cc1f-457c-a38b-a984e733116e", "address": "fa:16:3e:e0:f9:ce", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53e70b3-cc", "ovs_interfaceid": "b53e70b3-cc1f-457c-a38b-a984e733116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:24:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d5b57374-aef8-4f84-a353-f866306f104b req-fe76f075-33f2-4721-81ce-8d082d9dd63a service nova] Releasing lock "refresh_cache-9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:24:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-b3a50e3a-4043-40f1-a9b9-36c1d459e743 req-7819637e-337c-4848-b57c-f87b82c20fef service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Received event network-vif-plugged-b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b3a50e3a-4043-40f1-a9b9-36c1d459e743 req-7819637e-337c-4848-b57c-f87b82c20fef service nova] Acquiring lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b3a50e3a-4043-40f1-a9b9-36c1d459e743 req-7819637e-337c-4848-b57c-f87b82c20fef service nova] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b3a50e3a-4043-40f1-a9b9-36c1d459e743 req-7819637e-337c-4848-b57c-f87b82c20fef service nova] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-b3a50e3a-4043-40f1-a9b9-36c1d459e743 req-7819637e-337c-4848-b57c-f87b82c20fef service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] No waiting events found dispatching network-vif-plugged-b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:24:34 user nova-compute[71312]: WARNING nova.compute.manager [req-b3a50e3a-4043-40f1-a9b9-36c1d459e743 req-7819637e-337c-4848-b57c-f87b82c20fef service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Received unexpected event network-vif-plugged-b53e70b3-cc1f-457c-a38b-a984e733116e for instance with vm_state building and task_state spawning.
Jul 25 10:24:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:24:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:24:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:24:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:24:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:24:36 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280676.3620477, 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:24:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] VM Resumed (Lifecycle Event)
Jul 25 10:24:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:24:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:24:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Instance spawned successfully.
Jul 25 10:24:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:24:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:24:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:24:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:24:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:24:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:24:36 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280676.3622205, 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:24:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] VM Started (Lifecycle Event)
Jul 25 10:24:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:24:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:24:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-bda94cfb-0040-4349-82fe-1b6117ee2124 req-5e527cc0-2e4e-4d23-a961-292075283cc6 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Received event network-vif-plugged-b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bda94cfb-0040-4349-82fe-1b6117ee2124 req-5e527cc0-2e4e-4d23-a961-292075283cc6 service nova] Acquiring lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bda94cfb-0040-4349-82fe-1b6117ee2124 req-5e527cc0-2e4e-4d23-a961-292075283cc6 service nova] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bda94cfb-0040-4349-82fe-1b6117ee2124 req-5e527cc0-2e4e-4d23-a961-292075283cc6 service nova] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-bda94cfb-0040-4349-82fe-1b6117ee2124 req-5e527cc0-2e4e-4d23-a961-292075283cc6 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] No waiting events found dispatching network-vif-plugged-b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:24:36 user nova-compute[71312]: WARNING nova.compute.manager [req-bda94cfb-0040-4349-82fe-1b6117ee2124 req-5e527cc0-2e4e-4d23-a961-292075283cc6 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Received unexpected event network-vif-plugged-b53e70b3-cc1f-457c-a38b-a984e733116e for instance with vm_state building and task_state spawning.
Jul 25 10:24:36 user nova-compute[71312]: INFO nova.compute.manager [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Took 6.68 seconds to spawn the instance on the hypervisor.
Jul 25 10:24:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:24:36 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:24:36 user nova-compute[71312]: INFO nova.compute.manager [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Took 7.61 seconds to build instance.
Jul 25 10:24:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0e0dd86-1ec7-40d6-9073-88b1d10ea970 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.735s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:24:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:24:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:40 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:24:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:24:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:42 user nova-compute[71312]: INFO nova.compute.manager [None req-7517d0f7-34e8-4bcb-8253-81a651660a49 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Unrescuing
Jul 25 10:24:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7517d0f7-34e8-4bcb-8253-81a651660a49 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:24:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7517d0f7-34e8-4bcb-8253-81a651660a49 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquired lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:24:42 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7517d0f7-34e8-4bcb-8253-81a651660a49 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:24:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7517d0f7-34e8-4bcb-8253-81a651660a49 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Updating instance_info_cache with network_info: [{"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7517d0f7-34e8-4bcb-8253-81a651660a49 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Releasing lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7517d0f7-34e8-4bcb-8253-81a651660a49 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'flavor' on Instance uuid 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-1491098d-fc93-471a-bc90-a458be364009 req-574796ce-5830-4d41-8ed5-b077436b233f service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-unplugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1491098d-fc93-471a-bc90-a458be364009 req-574796ce-5830-4d41-8ed5-b077436b233f service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1491098d-fc93-471a-bc90-a458be364009 req-574796ce-5830-4d41-8ed5-b077436b233f service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1491098d-fc93-471a-bc90-a458be364009 req-574796ce-5830-4d41-8ed5-b077436b233f service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-1491098d-fc93-471a-bc90-a458be364009 req-574796ce-5830-4d41-8ed5-b077436b233f service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-unplugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:24:43 user nova-compute[71312]: WARNING nova.compute.manager [req-1491098d-fc93-471a-bc90-a458be364009 req-574796ce-5830-4d41-8ed5-b077436b233f service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-unplugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:24:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:44 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:24:44 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:24:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8295MB free_disk=25.023296356201172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:44 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Instance destroyed successfully.
Jul 25 10:24:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f7858973-7146-4229-9f41-00ebcc7618b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 411b2cee-bb2d-4b65-921c-3248c1edc454 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-0165cd7c-42dd-4670-b5bf-81862fdf3cdc req-11d5810c-7ee8-48a8-a806-e2f116137b8e service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-changed-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-0165cd7c-42dd-4670-b5bf-81862fdf3cdc req-11d5810c-7ee8-48a8-a806-e2f116137b8e service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Refreshing instance network info cache due to event network-changed-21c48988-5022-49f7-baa0-a10dfdc879bd. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0165cd7c-42dd-4670-b5bf-81862fdf3cdc req-11d5810c-7ee8-48a8-a806-e2f116137b8e service nova] Acquiring lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0165cd7c-42dd-4670-b5bf-81862fdf3cdc req-11d5810c-7ee8-48a8-a806-e2f116137b8e service nova] Acquired lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG nova.network.neutron [req-0165cd7c-42dd-4670-b5bf-81862fdf3cdc req-11d5810c-7ee8-48a8-a806-e2f116137b8e service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Refreshing network info cache for port 21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:24:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG nova.network.neutron [req-0165cd7c-42dd-4670-b5bf-81862fdf3cdc req-11d5810c-7ee8-48a8-a806-e2f116137b8e service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updated VIF entry in instance network info cache for port 21c48988-5022-49f7-baa0-a10dfdc879bd. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG nova.network.neutron [req-0165cd7c-42dd-4670-b5bf-81862fdf3cdc req-11d5810c-7ee8-48a8-a806-e2f116137b8e service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updating instance_info_cache with network_info: [{"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0165cd7c-42dd-4670-b5bf-81862fdf3cdc req-11d5810c-7ee8-48a8-a806-e2f116137b8e service nova] Releasing lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-2322abc9-7914-4778-b8ee-df7575f4d5f4 req-bfb07da5-f5bb-455b-90fd-d304c7a6e171 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2322abc9-7914-4778-b8ee-df7575f4d5f4 req-bfb07da5-f5bb-455b-90fd-d304c7a6e171 service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2322abc9-7914-4778-b8ee-df7575f4d5f4 req-bfb07da5-f5bb-455b-90fd-d304c7a6e171 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2322abc9-7914-4778-b8ee-df7575f4d5f4 req-bfb07da5-f5bb-455b-90fd-d304c7a6e171 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-2322abc9-7914-4778-b8ee-df7575f4d5f4 req-bfb07da5-f5bb-455b-90fd-d304c7a6e171 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:24:45 user nova-compute[71312]: WARNING nova.compute.manager [req-2322abc9-7914-4778-b8ee-df7575f4d5f4 req-bfb07da5-f5bb-455b-90fd-d304c7a6e171 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:24:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:24:45 user nova-compute[71312]: INFO nova.compute.claims [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Claim successful on node user
Jul 25 10:24:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:24:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:24:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG nova.policy [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b15229b8fb22457ca38b9c5bf2f6dbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55fc0544c744824b3b999ecfcf11e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:24:46 user nova-compute[71312]: INFO nova.virt.block_device [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Booting with volume 145feb09-c1a2-4c3a-8973-8b8eb5602eb3 at /dev/vda
Jul 25 10:24:46 user nova-compute[71312]: DEBUG os_brick.utils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7a7f8c-5930-4da1-a525-3979bd0ff060]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f74924f-1043-458b-9aef-c3e8c0af5d78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcdfc17-4c4b-4368-a8bc-909d5043468a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4600e72e-60e8-4bac-8c9a-4f6762acb9c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:24:46 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b26efaf-67f3-4f20-a40a-d090dec95056]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG os_brick.utils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Updating existing volume attachment record: dc8e8fa9-2eaa-4f2c-840d-d9b8c7314e7c {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:24:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Successfully created port: 559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-2c63e978-006c-4548-84d3-f17387a9e236 req-2cbc4433-0d64-407d-a2a0-e7a6ca4c57c6 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-changed-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-2c63e978-006c-4548-84d3-f17387a9e236 req-2cbc4433-0d64-407d-a2a0-e7a6ca4c57c6 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Refreshing instance network info cache due to event network-changed-21c48988-5022-49f7-baa0-a10dfdc879bd. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2c63e978-006c-4548-84d3-f17387a9e236 req-2cbc4433-0d64-407d-a2a0-e7a6ca4c57c6 service nova] Acquiring lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2c63e978-006c-4548-84d3-f17387a9e236 req-2cbc4433-0d64-407d-a2a0-e7a6ca4c57c6 service nova] Acquired lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-2c63e978-006c-4548-84d3-f17387a9e236 req-2cbc4433-0d64-407d-a2a0-e7a6ca4c57c6 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Refreshing network info cache for port 21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-8a1a0910-d784-4b36-b01f-10b3bbbe434c req-a5b30216-cd2f-49cb-833a-61e563492552 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8a1a0910-d784-4b36-b01f-10b3bbbe434c req-a5b30216-cd2f-49cb-833a-61e563492552 service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8a1a0910-d784-4b36-b01f-10b3bbbe434c req-a5b30216-cd2f-49cb-833a-61e563492552 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8a1a0910-d784-4b36-b01f-10b3bbbe434c req-a5b30216-cd2f-49cb-833a-61e563492552 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-8a1a0910-d784-4b36-b01f-10b3bbbe434c req-a5b30216-cd2f-49cb-833a-61e563492552 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:24:47 user nova-compute[71312]: WARNING nova.compute.manager [req-8a1a0910-d784-4b36-b01f-10b3bbbe434c req-a5b30216-cd2f-49cb-833a-61e563492552 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:24:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-8a1a0910-d784-4b36-b01f-10b3bbbe434c req-a5b30216-cd2f-49cb-833a-61e563492552 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8a1a0910-d784-4b36-b01f-10b3bbbe434c req-a5b30216-cd2f-49cb-833a-61e563492552 service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8a1a0910-d784-4b36-b01f-10b3bbbe434c req-a5b30216-cd2f-49cb-833a-61e563492552 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8a1a0910-d784-4b36-b01f-10b3bbbe434c req-a5b30216-cd2f-49cb-833a-61e563492552 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-8a1a0910-d784-4b36-b01f-10b3bbbe434c req-a5b30216-cd2f-49cb-833a-61e563492552 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:24:47 user nova-compute[71312]: WARNING nova.compute.manager [req-8a1a0910-d784-4b36-b01f-10b3bbbe434c req-a5b30216-cd2f-49cb-833a-61e563492552 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:24:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-2c63e978-006c-4548-84d3-f17387a9e236 req-2cbc4433-0d64-407d-a2a0-e7a6ca4c57c6 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updated VIF entry in instance network info cache for port 21c48988-5022-49f7-baa0-a10dfdc879bd. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-2c63e978-006c-4548-84d3-f17387a9e236 req-2cbc4433-0d64-407d-a2a0-e7a6ca4c57c6 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updating instance_info_cache with network_info: [{"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2c63e978-006c-4548-84d3-f17387a9e236 req-2cbc4433-0d64-407d-a2a0-e7a6ca4c57c6 service nova] Releasing lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Successfully updated port: 559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "refresh_cache-19ed556d-1ecc-4252-bd17-2c8bf555f8be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquired lock "refresh_cache-19ed556d-1ecc-4252-bd17-2c8bf555f8be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-39e70566-0752-4b4d-8389-ebf230b74bf2 req-790f7ca0-8bf5-4b5c-b13f-3c2c0d79113e service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received event network-changed-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-39e70566-0752-4b4d-8389-ebf230b74bf2 req-790f7ca0-8bf5-4b5c-b13f-3c2c0d79113e service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Refreshing instance network info cache due to event network-changed-559eef7f-1e5c-4d3b-968a-4196be42f303. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:24:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-39e70566-0752-4b4d-8389-ebf230b74bf2 req-790f7ca0-8bf5-4b5c-b13f-3c2c0d79113e service nova] Acquiring lock "refresh_cache-19ed556d-1ecc-4252-bd17-2c8bf555f8be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:24:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Removed pending event for 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 10:24:48 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280688.07833, 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:24:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] VM Resumed (Lifecycle Event)
Jul 25 10:24:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7517d0f7-34e8-4bcb-8253-81a651660a49 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:24:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:24:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:24:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 25 10:24:48 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280688.0809488, 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:24:48 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] VM Started (Lifecycle Event)
Jul 25 10:24:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:24:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:24:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:24:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Updating instance_info_cache with network_info: [{"id": "559eef7f-1e5c-4d3b-968a-4196be42f303", "address": "fa:16:3e:1f:c6:a5", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559eef7f-1e", "ovs_interfaceid": "559eef7f-1e5c-4d3b-968a-4196be42f303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:24:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Releasing lock "refresh_cache-19ed556d-1ecc-4252-bd17-2c8bf555f8be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:24:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Instance network_info: |[{"id": "559eef7f-1e5c-4d3b-968a-4196be42f303", "address": "fa:16:3e:1f:c6:a5", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559eef7f-1e", "ovs_interfaceid": "559eef7f-1e5c-4d3b-968a-4196be42f303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:24:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-39e70566-0752-4b4d-8389-ebf230b74bf2 req-790f7ca0-8bf5-4b5c-b13f-3c2c0d79113e service nova] Acquired lock "refresh_cache-19ed556d-1ecc-4252-bd17-2c8bf555f8be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:24:48 user nova-compute[71312]: DEBUG nova.network.neutron [req-39e70566-0752-4b4d-8389-ebf230b74bf2 req-790f7ca0-8bf5-4b5c-b13f-3c2c0d79113e service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Refreshing network info cache for port 559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:24:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-39e70566-0752-4b4d-8389-ebf230b74bf2 req-790f7ca0-8bf5-4b5c-b13f-3c2c0d79113e service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Updated VIF entry in instance network info cache for port 559eef7f-1e5c-4d3b-968a-4196be42f303. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:24:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-39e70566-0752-4b4d-8389-ebf230b74bf2 req-790f7ca0-8bf5-4b5c-b13f-3c2c0d79113e service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Updating instance_info_cache with network_info: [{"id": "559eef7f-1e5c-4d3b-968a-4196be42f303", "address": "fa:16:3e:1f:c6:a5", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559eef7f-1e", "ovs_interfaceid": "559eef7f-1e5c-4d3b-968a-4196be42f303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:24:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-39e70566-0752-4b4d-8389-ebf230b74bf2 req-790f7ca0-8bf5-4b5c-b13f-3c2c0d79113e service nova] Releasing lock "refresh_cache-19ed556d-1ecc-4252-bd17-2c8bf555f8be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:24:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:52 user nova-compute[71312]: INFO nova.compute.manager [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Rebooting instance
Jul 25 10:24:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:24:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquired lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:24:52 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:24:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updating instance_info_cache with network_info: [{"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Releasing lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-8738fbbd-dff5-494e-b11a-3e4eae6cf098 req-e92a51a1-3bf2-46d6-81bc-6bd38c06502c service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-vif-unplugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8738fbbd-dff5-494e-b11a-3e4eae6cf098 req-e92a51a1-3bf2-46d6-81bc-6bd38c06502c service nova] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8738fbbd-dff5-494e-b11a-3e4eae6cf098 req-e92a51a1-3bf2-46d6-81bc-6bd38c06502c service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8738fbbd-dff5-494e-b11a-3e4eae6cf098 req-e92a51a1-3bf2-46d6-81bc-6bd38c06502c service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-8738fbbd-dff5-494e-b11a-3e4eae6cf098 req-e92a51a1-3bf2-46d6-81bc-6bd38c06502c service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] No waiting events found dispatching network-vif-unplugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:24:53 user nova-compute[71312]: WARNING nova.compute.manager [req-8738fbbd-dff5-494e-b11a-3e4eae6cf098 req-e92a51a1-3bf2-46d6-81bc-6bd38c06502c service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received unexpected event network-vif-unplugged-21c48988-5022-49f7-baa0-a10dfdc879bd for instance with vm_state active and task_state reboot_started_hard.
Jul 25 10:24:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:24:53 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Creating image(s)
Jul 25 10:24:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Ensure instance console log exists: /opt/stack/data/nova/instances/19ed556d-1ecc-4252-bd17-2c8bf555f8be/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Start _get_guest_xml network_info=[{"id": "559eef7f-1e5c-4d3b-968a-4196be42f303", "address": "fa:16:3e:1f:c6:a5", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559eef7f-1e", "ovs_interfaceid": "559eef7f-1e5c-4d3b-968a-4196be42f303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'dc8e8fa9-2eaa-4f2c-840d-d9b8c7314e7c', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hERVNXLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '19ed556d-1ecc-4252-bd17-2c8bf555f8be', 'attached_at': '', 'detached_at': '', 'volume_id': '145feb09-c1a2-4c3a-8973-8b8eb5602eb3', 'serial': '145feb09-c1a2-4c3a-8973-8b8eb5602eb3'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:24:54 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:24:54 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hERVNXLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:24:54 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:24:54 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:24:54 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc00fa5-e0dc-4be2-8cbb-3a193749bc91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:24:54 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c132ba-ef24-4a3f-9e1d-ae888d40e556]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3] added
Jul 25 10:24:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34124d2-1a16-4c3f-b3d0-119601bae667]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f730273-6f92-4c06-9054-b1c0355cb003]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hERVNXLY {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hERVNXLY" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aab358-2139-4e88-a62c-110f963eed90]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hERVNXLY'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec44e087-2b3c-4fff-b8b2-60f9a429032c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[818653cd-39ea-4286-b573-c28699a25564]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:24:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:24:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[81edf565-40ec-4d5b-a1b7-057d78dee977]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3, portal: 172.16.0.220,3260]
Jul 25 10:24:54 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3, portal: 172.16.0.220,3260] successful.
Jul 25 10:24:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:54 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Instance destroyed successfully.
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'resources' on Instance uuid 411b2cee-bb2d-4b65-921c-3248c1edc454 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc84798-0ad9-462a-b851-6ce01e4b00aa]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1650432608',display_name='tempest-TestMinimumBasicScenario-server-1650432608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1650432608',id=41,image_ref='d9c394da-76f3-4440-a72f-e13318a0982c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGg3j14zcpk1Y5NEPPiDHV/l/W/r76eTIQ6WTapG9XZ5IbgVeFP1qKyfBeaNpLBhqdsADos6R8ho5+EZ8JxYEhwl8T8FnA+Tk0HcWqExlEpdX5Ph68BTxiht5yVBbwwmA==',key_name='tempest-TestMinimumBasicScenario-271951688',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:22:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d929f478538e4a13808c730ae670e6ac',ramdisk_id='',reservation_id='r-pxzhwxzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d9c394da-76f3-4440-a72f-e13318a0982c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1169366909',owner_user_name='tempest-TestMinimumBasicScenario-1169366909-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:24:53Z,user_data=None,user_id='12610a082fb54137a6c6752c800bd393',uuid=411b2cee-bb2d-4b65-921c-3248c1edc454,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converting VIF {"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:42:1f,bridge_name='br-int',has_traffic_filtering=True,id=21c48988-5022-49f7-baa0-a10dfdc879bd,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c48988-50') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_vif [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:42:1f,bridge_name='br-int',has_traffic_filtering=True,id=21c48988-5022-49f7-baa0-a10dfdc879bd,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c48988-50') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21c48988-50, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb16cad-07a1-4e21-ab9d-e66047e1cddd]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:24:54 user nova-compute[71312]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:24:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:24:54 user nova-compute[71312]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:24:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:54 user nova-compute[71312]: INFO os_vif [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:42:1f,bridge_name='br-int',has_traffic_filtering=True,id=21c48988-5022-49f7-baa0-a10dfdc879bd,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c48988-50')
Jul 25 10:24:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TExdpjmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:24:54 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[19586b3b-dc74-45d4-8df3-fddbefc53101]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hERVNXLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26363623735336232', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363623735336232', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.018s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8999bc93-5866-4fa8-97d5-d9ad88b78c76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:24:55 user nova-compute[71312]: No targets found.
Jul 25 10:24:55 user nova-compute[71312]: iSNS:
Jul 25 10:24:55 user nova-compute[71312]: No targets found.
Jul 25 10:24:55 user nova-compute[71312]: STATIC:
Jul 25 10:24:55 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3
Jul 25 10:24:55 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:24:55 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:24:55 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b
Jul 25 10:24:55 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:24:55 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:24:55 user nova-compute[71312]: FIRMWARE:
Jul 25 10:24:55 user nova-compute[71312]: No targets found.
Jul 25 10:24:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:24:55 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:24:55 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1060455060',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1060455060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1060455060',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT8DKuSxsIqkBg4nDSuIphsnsU5l/P/yvq/kxh41/jr8G7bNJnPjReVMX2aamSQSnVlgfSABJ0F3O5gvpgVTHa5xUuZTOuZCDxBzN3ZCBPTRPqVc3LkEvS1Wj6gfKL85g==',key_name='tempest-keypair-1762312947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-dj350rb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:24:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=19ed556d-1ecc-4252-bd17-2c8bf555f8be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "559eef7f-1e5c-4d3b-968a-4196be42f303", "address": "fa:16:3e:1f:c6:a5", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559eef7f-1e", "ovs_interfaceid": "559eef7f-1e5c-4d3b-968a-4196be42f303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "559eef7f-1e5c-4d3b-968a-4196be42f303", "address": "fa:16:3e:1f:c6:a5", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559eef7f-1e", "ovs_interfaceid": "559eef7f-1e5c-4d3b-968a-4196be42f303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c6:a5,bridge_name='br-int',has_traffic_filtering=True,id=559eef7f-1e5c-4d3b-968a-4196be42f303,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559eef7f-1e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.objects.instance [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lazy-loading 'pci_devices' on Instance uuid 19ed556d-1ecc-4252-bd17-2c8bf555f8be {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:24:55 user nova-compute[71312]:   <uuid>19ed556d-1ecc-4252-bd17-2c8bf555f8be</uuid>
Jul 25 10:24:55 user nova-compute[71312]:   <name>instance-0000002b</name>
Jul 25 10:24:55 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:24:55 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:24:55 user nova-compute[71312]:   <metadata>
Jul 25 10:24:55 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:24:55 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:24:55 user nova-compute[71312]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1060455060</nova:name>
Jul 25 10:24:55 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:24:54</nova:creationTime>
Jul 25 10:24:55 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:24:55 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:24:55 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:24:55 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:24:55 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:24:55 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:24:55 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:24:55 user nova-compute[71312]:       <nova:owner>
Jul 25 10:24:55 user nova-compute[71312]:         <nova:user uuid="b15229b8fb22457ca38b9c5bf2f6dbc3">tempest-TestVolumeBootPattern-614700428-project-member</nova:user>
Jul 25 10:24:55 user nova-compute[71312]:         <nova:project uuid="e55fc0544c744824b3b999ecfcf11e31">tempest-TestVolumeBootPattern-614700428</nova:project>
Jul 25 10:24:55 user nova-compute[71312]:       </nova:owner>
Jul 25 10:24:55 user nova-compute[71312]:       <nova:ports>
Jul 25 10:24:55 user nova-compute[71312]:         <nova:port uuid="559eef7f-1e5c-4d3b-968a-4196be42f303">
Jul 25 10:24:55 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 10:24:55 user nova-compute[71312]:         </nova:port>
Jul 25 10:24:55 user nova-compute[71312]:       </nova:ports>
Jul 25 10:24:55 user nova-compute[71312]:     </nova:instance>
Jul 25 10:24:55 user nova-compute[71312]:   </metadata>
Jul 25 10:24:55 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:24:55 user nova-compute[71312]:     <system>
Jul 25 10:24:55 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:24:55 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:24:55 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:24:55 user nova-compute[71312]:       <entry name="serial">19ed556d-1ecc-4252-bd17-2c8bf555f8be</entry>
Jul 25 10:24:55 user nova-compute[71312]:       <entry name="uuid">19ed556d-1ecc-4252-bd17-2c8bf555f8be</entry>
Jul 25 10:24:55 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:24:55 user nova-compute[71312]:     </system>
Jul 25 10:24:55 user nova-compute[71312]:   </sysinfo>
Jul 25 10:24:55 user nova-compute[71312]:   <os>
Jul 25 10:24:55 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:24:55 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:24:55 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:24:55 user nova-compute[71312]:   </os>
Jul 25 10:24:55 user nova-compute[71312]:   <features>
Jul 25 10:24:55 user nova-compute[71312]:     <acpi/>
Jul 25 10:24:55 user nova-compute[71312]:     <apic/>
Jul 25 10:24:55 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:24:55 user nova-compute[71312]:   </features>
Jul 25 10:24:55 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:24:55 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:24:55 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:24:55 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:24:55 user nova-compute[71312]:   </clock>
Jul 25 10:24:55 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:24:55 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:24:55 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:24:55 user nova-compute[71312]:   </cpu>
Jul 25 10:24:55 user nova-compute[71312]:   <devices>
Jul 25 10:24:55 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:24:55 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:24:55 user nova-compute[71312]:       <source dev="/dev/sdc"/>
Jul 25 10:24:55 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:24:55 user nova-compute[71312]:       <serial>145feb09-c1a2-4c3a-8973-8b8eb5602eb3</serial>
Jul 25 10:24:55 user nova-compute[71312]:     </disk>
Jul 25 10:24:55 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:24:55 user nova-compute[71312]:       <mac address="fa:16:3e:1f:c6:a5"/>
Jul 25 10:24:55 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:24:55 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:24:55 user nova-compute[71312]:       <target dev="tap559eef7f-1e"/>
Jul 25 10:24:55 user nova-compute[71312]:     </interface>
Jul 25 10:24:55 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:24:55 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/19ed556d-1ecc-4252-bd17-2c8bf555f8be/console.log" append="off"/>
Jul 25 10:24:55 user nova-compute[71312]:     </serial>
Jul 25 10:24:55 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:24:55 user nova-compute[71312]:     <video>
Jul 25 10:24:55 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:24:55 user nova-compute[71312]:     </video>
Jul 25 10:24:55 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:24:55 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:24:55 user nova-compute[71312]:     </rng>
Jul 25 10:24:55 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:24:55 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:24:55 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:24:55 user nova-compute[71312]:     </memballoon>
Jul 25 10:24:55 user nova-compute[71312]:   </devices>
Jul 25 10:24:55 user nova-compute[71312]: </domain>
Jul 25 10:24:55 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1060455060',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1060455060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1060455060',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT8DKuSxsIqkBg4nDSuIphsnsU5l/P/yvq/kxh41/jr8G7bNJnPjReVMX2aamSQSnVlgfSABJ0F3O5gvpgVTHa5xUuZTOuZCDxBzN3ZCBPTRPqVc3LkEvS1Wj6gfKL85g==',key_name='tempest-keypair-1762312947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-dj350rb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:24:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=19ed556d-1ecc-4252-bd17-2c8bf555f8be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "559eef7f-1e5c-4d3b-968a-4196be42f303", "address": "fa:16:3e:1f:c6:a5", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559eef7f-1e", "ovs_interfaceid": "559eef7f-1e5c-4d3b-968a-4196be42f303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "559eef7f-1e5c-4d3b-968a-4196be42f303", "address": "fa:16:3e:1f:c6:a5", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559eef7f-1e", "ovs_interfaceid": "559eef7f-1e5c-4d3b-968a-4196be42f303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c6:a5,bridge_name='br-int',has_traffic_filtering=True,id=559eef7f-1e5c-4d3b-968a-4196be42f303,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559eef7f-1e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_vif [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c6:a5,bridge_name='br-int',has_traffic_filtering=True,id=559eef7f-1e5c-4d3b-968a-4196be42f303,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559eef7f-1e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be9233d-0b5d-44b9-bd42-49e7fe85aaa8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap559eef7f-1e, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap559eef7f-1e, col_values=(('external_ids', {'iface-id': '559eef7f-1e5c-4d3b-968a-4196be42f303', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:c6:a5', 'vm-uuid': '19ed556d-1ecc-4252-bd17-2c8bf555f8be'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:55 user nova-compute[71312]: INFO os_vif [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c6:a5,bridge_name='br-int',has_traffic_filtering=True,id=559eef7f-1e5c-4d3b-968a-4196be42f303,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559eef7f-1e')
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3b604b-c9f7-4048-be85-9bf27fbfc471]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:24:55 user nova-compute[71312]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:24:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:24:55 user nova-compute[71312]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:24:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9cee30ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[068c1cdf-1412-47b0-85cb-11f0115c5948]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] No VIF found with MAC fa:16:3e:1f:c6:a5, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdd2418-81a8-45e9-8ac9-6bd56eb61c38]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d8c471-2fb7-4bc8-8e51-2faa01b276e4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce10f5dc-b48b-4901-891b-ff42ad74f2d1]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8a802d-af72-4edb-9baf-1b1683690933]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f2dc8e-fee5-4909-9de0-364d0d3c28c5]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260]
Jul 25 10:24:55 user nova-compute[71312]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260] successful.
Jul 25 10:24:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[177f5f14-98ac-4d34-9bb7-19df4d39229d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] <== disconnect_volume: return (1329ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Start _get_guest_xml network_info=[{"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d9c394da-76f3-4440-a72f-e13318a0982c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'd9c394da-76f3-4440-a72f-e13318a0982c'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '852ed70b-b113-4dad-94e5-e138b0190271', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TExdpjmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '411b2cee-bb2d-4b65-921c-3248c1edc454', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3968fd3-3a2f-441c-aa7d-22623ad4240b', 'serial': 'c3968fd3-3a2f-441c-aa7d-22623ad4240b'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:24:55 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:24:55 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d9c394da-76f3-4440-a72f-e13318a0982c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'vcpu_model' on Instance uuid 411b2cee-bb2d-4b65-921c-3248c1edc454 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TExdpjmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:24:55 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:24:55 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:24:55 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9797d66-09ee-444d-8433-1da02a35e338]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:24:55 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-bef15cbe-27a3-4def-9ed3-31413dd4f3fb req-47ef87b2-69b7-4ad2-b32d-5a08a4e64eb6 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bef15cbe-27a3-4def-9ed3-31413dd4f3fb req-47ef87b2-69b7-4ad2-b32d-5a08a4e64eb6 service nova] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bef15cbe-27a3-4def-9ed3-31413dd4f3fb req-47ef87b2-69b7-4ad2-b32d-5a08a4e64eb6 service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bef15cbe-27a3-4def-9ed3-31413dd4f3fb req-47ef87b2-69b7-4ad2-b32d-5a08a4e64eb6 service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-bef15cbe-27a3-4def-9ed3-31413dd4f3fb req-47ef87b2-69b7-4ad2-b32d-5a08a4e64eb6 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] No waiting events found dispatching network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:24:55 user nova-compute[71312]: WARNING nova.compute.manager [req-bef15cbe-27a3-4def-9ed3-31413dd4f3fb req-47ef87b2-69b7-4ad2-b32d-5a08a4e64eb6 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received unexpected event network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd for instance with vm_state active and task_state reboot_started_hard.
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.084s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6411fba-cba9-4215-a288-cd25216efd9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b] added
Jul 25 10:24:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ad05bd-5f32-44ed-912a-b5a659a77bbe]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[14130a4f-b347-4d86-858a-526723bfea00]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TExdpjmF {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TExdpjmF" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[75688cfd-36d4-486d-9209-b3fd5021f7f6]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TExdpjmF'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff1ac1a-2015-4d6f-9353-d3c0e87eccf5]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f303b675-d472-4f19-a0e6-84700681c255]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:24:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:24:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf86115f-3139-4a3c-96cf-f814770ba8c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260]
Jul 25 10:24:56 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260] successful.
Jul 25 10:24:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a052594-4777-46ab-b3cf-cf5ea3aebab1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[432f673a-d164-44af-b354-666650f95ca3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:24:56 user nova-compute[71312]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:24:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:24:56 user nova-compute[71312]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:24:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebd4f96-5077-4245-aa10-94a276ce8c0f]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TExdpjmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-6c206780-898f-417d-9656-7ee93b1afe06 req-642b147f-ba93-44d2-9e99-9baa87fbf9fe service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received event network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6c206780-898f-417d-9656-7ee93b1afe06 req-642b147f-ba93-44d2-9e99-9baa87fbf9fe service nova] Acquiring lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6c206780-898f-417d-9656-7ee93b1afe06 req-642b147f-ba93-44d2-9e99-9baa87fbf9fe service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6c206780-898f-417d-9656-7ee93b1afe06 req-642b147f-ba93-44d2-9e99-9baa87fbf9fe service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-6c206780-898f-417d-9656-7ee93b1afe06 req-642b147f-ba93-44d2-9e99-9baa87fbf9fe service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] No waiting events found dispatching network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:24:57 user nova-compute[71312]: WARNING nova.compute.manager [req-6c206780-898f-417d-9656-7ee93b1afe06 req-642b147f-ba93-44d2-9e99-9baa87fbf9fe service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received unexpected event network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 for instance with vm_state building and task_state spawning.
Jul 25 10:24:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26332396162333166', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332396162333166', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1650432608',display_name='tempest-TestMinimumBasicScenario-server-1650432608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1650432608',id=41,image_ref='d9c394da-76f3-4440-a72f-e13318a0982c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGg3j14zcpk1Y5NEPPiDHV/l/W/r76eTIQ6WTapG9XZ5IbgVeFP1qKyfBeaNpLBhqdsADos6R8ho5+EZ8JxYEhwl8T8FnA+Tk0HcWqExlEpdX5Ph68BTxiht5yVBbwwmA==',key_name='tempest-TestMinimumBasicScenario-271951688',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:22:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d929f478538e4a13808c730ae670e6ac',ramdisk_id='',reservation_id='r-pxzhwxzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d9c394da-76f3-4440-a72f-e13318a0982c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1169366909',owner_user_name='tempest-TestMinimumBasicScenario-1169366909-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:24:53Z,user_data=None,user_id='12610a082fb54137a6c6752c800bd393',uuid=411b2cee-bb2d-4b65-921c-3248c1edc454,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converting VIF {"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:42:1f,bridge_name='br-int',has_traffic_filtering=True,id=21c48988-5022-49f7-baa0-a10dfdc879bd,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c48988-50') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'pci_devices' on Instance uuid 411b2cee-bb2d-4b65-921c-3248c1edc454 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:24:57 user nova-compute[71312]:   <uuid>411b2cee-bb2d-4b65-921c-3248c1edc454</uuid>
Jul 25 10:24:57 user nova-compute[71312]:   <name>instance-00000029</name>
Jul 25 10:24:57 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:24:57 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:24:57 user nova-compute[71312]:   <metadata>
Jul 25 10:24:57 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:24:57 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:24:57 user nova-compute[71312]:       <nova:name>tempest-TestMinimumBasicScenario-server-1650432608</nova:name>
Jul 25 10:24:57 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:24:55</nova:creationTime>
Jul 25 10:24:57 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:24:57 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:24:57 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:24:57 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:24:57 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:24:57 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:24:57 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:24:57 user nova-compute[71312]:       <nova:owner>
Jul 25 10:24:57 user nova-compute[71312]:         <nova:user uuid="12610a082fb54137a6c6752c800bd393">tempest-TestMinimumBasicScenario-1169366909-project-member</nova:user>
Jul 25 10:24:57 user nova-compute[71312]:         <nova:project uuid="d929f478538e4a13808c730ae670e6ac">tempest-TestMinimumBasicScenario-1169366909</nova:project>
Jul 25 10:24:57 user nova-compute[71312]:       </nova:owner>
Jul 25 10:24:57 user nova-compute[71312]:       <nova:root type="image" uuid="d9c394da-76f3-4440-a72f-e13318a0982c"/>
Jul 25 10:24:57 user nova-compute[71312]:       <nova:ports>
Jul 25 10:24:57 user nova-compute[71312]:         <nova:port uuid="21c48988-5022-49f7-baa0-a10dfdc879bd">
Jul 25 10:24:57 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 10:24:57 user nova-compute[71312]:         </nova:port>
Jul 25 10:24:57 user nova-compute[71312]:       </nova:ports>
Jul 25 10:24:57 user nova-compute[71312]:     </nova:instance>
Jul 25 10:24:57 user nova-compute[71312]:   </metadata>
Jul 25 10:24:57 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:24:57 user nova-compute[71312]:     <system>
Jul 25 10:24:57 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:24:57 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:24:57 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:24:57 user nova-compute[71312]:       <entry name="serial">411b2cee-bb2d-4b65-921c-3248c1edc454</entry>
Jul 25 10:24:57 user nova-compute[71312]:       <entry name="uuid">411b2cee-bb2d-4b65-921c-3248c1edc454</entry>
Jul 25 10:24:57 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:24:57 user nova-compute[71312]:     </system>
Jul 25 10:24:57 user nova-compute[71312]:   </sysinfo>
Jul 25 10:24:57 user nova-compute[71312]:   <os>
Jul 25 10:24:57 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:24:57 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:24:57 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:24:57 user nova-compute[71312]:   </os>
Jul 25 10:24:57 user nova-compute[71312]:   <features>
Jul 25 10:24:57 user nova-compute[71312]:     <acpi/>
Jul 25 10:24:57 user nova-compute[71312]:     <apic/>
Jul 25 10:24:57 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:24:57 user nova-compute[71312]:   </features>
Jul 25 10:24:57 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:24:57 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:24:57 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:24:57 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:24:57 user nova-compute[71312]:   </clock>
Jul 25 10:24:57 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:24:57 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:24:57 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:24:57 user nova-compute[71312]:   </cpu>
Jul 25 10:24:57 user nova-compute[71312]:   <devices>
Jul 25 10:24:57 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:24:57 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:24:57 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk"/>
Jul 25 10:24:57 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:24:57 user nova-compute[71312]:     </disk>
Jul 25 10:24:57 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:24:57 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:24:57 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Jul 25 10:24:57 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Jul 25 10:24:57 user nova-compute[71312]:       <serial>c3968fd3-3a2f-441c-aa7d-22623ad4240b</serial>
Jul 25 10:24:57 user nova-compute[71312]:     </disk>
Jul 25 10:24:57 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:24:57 user nova-compute[71312]:       <mac address="fa:16:3e:61:42:1f"/>
Jul 25 10:24:57 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:24:57 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:24:57 user nova-compute[71312]:       <target dev="tap21c48988-50"/>
Jul 25 10:24:57 user nova-compute[71312]:     </interface>
Jul 25 10:24:57 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:24:57 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/console.log" append="off"/>
Jul 25 10:24:57 user nova-compute[71312]:     </serial>
Jul 25 10:24:57 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:24:57 user nova-compute[71312]:     <video>
Jul 25 10:24:57 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:24:57 user nova-compute[71312]:     </video>
Jul 25 10:24:57 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:24:57 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:24:57 user nova-compute[71312]:     </rng>
Jul 25 10:24:57 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:24:57 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:24:57 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:24:57 user nova-compute[71312]:     </memballoon>
Jul 25 10:24:57 user nova-compute[71312]:   </devices>
Jul 25 10:24:57 user nova-compute[71312]: </domain>
Jul 25 10:24:57 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'trusted_certs' on Instance uuid 411b2cee-bb2d-4b65-921c-3248c1edc454 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0 --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Cannot resize image /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'migration_context' on Instance uuid 411b2cee-bb2d-4b65-921c-3248c1edc454 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1650432608',display_name='tempest-TestMinimumBasicScenario-server-1650432608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1650432608',id=41,image_ref='d9c394da-76f3-4440-a72f-e13318a0982c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGg3j14zcpk1Y5NEPPiDHV/l/W/r76eTIQ6WTapG9XZ5IbgVeFP1qKyfBeaNpLBhqdsADos6R8ho5+EZ8JxYEhwl8T8FnA+Tk0HcWqExlEpdX5Ph68BTxiht5yVBbwwmA==',key_name='tempest-TestMinimumBasicScenario-271951688',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:22:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='d929f478538e4a13808c730ae670e6ac',ramdisk_id='',reservation_id='r-pxzhwxzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d9c394da-76f3-4440-a72f-e13318a0982c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1169366909',owner_user_name='tempest-TestMinimumBasicScenario-1169366909-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:24:53Z,user_data=None,user_id='12610a082fb54137a6c6752c800bd393',uuid=411b2cee-bb2d-4b65-921c-3248c1edc454,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converting VIF {"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:42:1f,bridge_name='br-int',has_traffic_filtering=True,id=21c48988-5022-49f7-baa0-a10dfdc879bd,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c48988-50') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG os_vif [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:42:1f,bridge_name='br-int',has_traffic_filtering=True,id=21c48988-5022-49f7-baa0-a10dfdc879bd,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c48988-50') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21c48988-50, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21c48988-50, col_values=(('external_ids', {'iface-id': '21c48988-5022-49f7-baa0-a10dfdc879bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:42:1f', 'vm-uuid': '411b2cee-bb2d-4b65-921c-3248c1edc454'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:24:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:57 user nova-compute[71312]: INFO os_vif [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:42:1f,bridge_name='br-int',has_traffic_filtering=True,id=21c48988-5022-49f7-baa0-a10dfdc879bd,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c48988-50')
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280699.0483437, 19ed556d-1ecc-4252-bd17-2c8bf555f8be => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:24:59 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] VM Resumed (Lifecycle Event)
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:24:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Instance spawned successfully.
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:24:59 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280699.052321, 19ed556d-1ecc-4252-bd17-2c8bf555f8be => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:24:59 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] VM Started (Lifecycle Event)
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-1787f479-bc13-4af1-a2d3-4dbc538420f6 req-bd1c75ac-177a-4ded-96a8-9b01c719ced8 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received event network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1787f479-bc13-4af1-a2d3-4dbc538420f6 req-bd1c75ac-177a-4ded-96a8-9b01c719ced8 service nova] Acquiring lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1787f479-bc13-4af1-a2d3-4dbc538420f6 req-bd1c75ac-177a-4ded-96a8-9b01c719ced8 service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1787f479-bc13-4af1-a2d3-4dbc538420f6 req-bd1c75ac-177a-4ded-96a8-9b01c719ced8 service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-1787f479-bc13-4af1-a2d3-4dbc538420f6 req-bd1c75ac-177a-4ded-96a8-9b01c719ced8 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] No waiting events found dispatching network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:24:59 user nova-compute[71312]: WARNING nova.compute.manager [req-1787f479-bc13-4af1-a2d3-4dbc538420f6 req-bd1c75ac-177a-4ded-96a8-9b01c719ced8 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received unexpected event network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 for instance with vm_state building and task_state spawning.
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:24:59 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:24:59 user nova-compute[71312]: INFO nova.compute.manager [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Took 5.28 seconds to spawn the instance on the hypervisor.
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:24:59 user nova-compute[71312]: INFO nova.compute.manager [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Took 13.63 seconds to build instance.
Jul 25 10:24:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-966a96d2-192c-4a5e-9b7c-17c038a48e4c tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.757s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-9a0b57a1-daf2-4a94-9bf2-5686bba975aa req-9309cace-6155-4266-940b-44ec9ebba922 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a0b57a1-daf2-4a94-9bf2-5686bba975aa req-9309cace-6155-4266-940b-44ec9ebba922 service nova] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a0b57a1-daf2-4a94-9bf2-5686bba975aa req-9309cace-6155-4266-940b-44ec9ebba922 service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a0b57a1-daf2-4a94-9bf2-5686bba975aa req-9309cace-6155-4266-940b-44ec9ebba922 service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:24:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-9a0b57a1-daf2-4a94-9bf2-5686bba975aa req-9309cace-6155-4266-940b-44ec9ebba922 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] No waiting events found dispatching network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:24:59 user nova-compute[71312]: WARNING nova.compute.manager [req-9a0b57a1-daf2-4a94-9bf2-5686bba975aa req-9309cace-6155-4266-940b-44ec9ebba922 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received unexpected event network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd for instance with vm_state active and task_state reboot_started_hard.
Jul 25 10:24:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Removed pending event for 411b2cee-bb2d-4b65-921c-3248c1edc454 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 10:25:01 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280701.547136, 411b2cee-bb2d-4b65-921c-3248c1edc454 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:25:01 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] VM Resumed (Lifecycle Event)
Jul 25 10:25:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:25:01 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Instance rebooted successfully.
Jul 25 10:25:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:25:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:25:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:25:01 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 25 10:25:01 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280701.5481708, 411b2cee-bb2d-4b65-921c-3248c1edc454 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:25:01 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] VM Started (Lifecycle Event)
Jul 25 10:25:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:25:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:25:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6db9ce96-7f69-4f11-8b2c-8a5e77f9210f tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.940s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:25:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-31904c75-c9b9-4b59-9dfd-3bbfae692c0a req-2b18f0f5-5fe6-4fd9-b536-99a2807807fd service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:25:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-31904c75-c9b9-4b59-9dfd-3bbfae692c0a req-2b18f0f5-5fe6-4fd9-b536-99a2807807fd service nova] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:25:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-31904c75-c9b9-4b59-9dfd-3bbfae692c0a req-2b18f0f5-5fe6-4fd9-b536-99a2807807fd service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:25:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-31904c75-c9b9-4b59-9dfd-3bbfae692c0a req-2b18f0f5-5fe6-4fd9-b536-99a2807807fd service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:25:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-31904c75-c9b9-4b59-9dfd-3bbfae692c0a req-2b18f0f5-5fe6-4fd9-b536-99a2807807fd service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] No waiting events found dispatching network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:25:01 user nova-compute[71312]: WARNING nova.compute.manager [req-31904c75-c9b9-4b59-9dfd-3bbfae692c0a req-2b18f0f5-5fe6-4fd9-b536-99a2807807fd service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received unexpected event network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd for instance with vm_state active and task_state None.
Jul 25 10:25:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:25:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:25:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:25:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:25:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:25:33 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Updating instance_info_cache with network_info: [{"id": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "address": "fa:16:3e:54:ae:25", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0efcfa-7e", "ovs_interfaceid": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:25:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:25:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:25:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:25:34 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:25:34 user nova-compute[71312]: INFO nova.compute.claims [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Claim successful on node user
Jul 25 10:25:34 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:25:34 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:25:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:25:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:25:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:25:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:25:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:25:34 user nova-compute[71312]: INFO nova.virt.block_device [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Booting with volume e0ea030e-6877-456c-bfe4-aaecaf996939 at /dev/vda
Jul 25 10:25:34 user nova-compute[71312]: DEBUG nova.policy [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79d1e9b058e541babcbd999c4772e841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bafba94e094b77a9c0a19358ab4af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG os_brick.utils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aaf8ec-0a99-4a7a-9113-9d9924e947f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c027412-5555-4f6f-9594-5b6525ab0165]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f908067-7529-4c75-95ef-93c575f3533f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c578ba-12d8-4e3a-8eb4-96635c10e1fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:25:35 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9ec9f3-7760-4c16-b4e0-54590154174c]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG os_brick.utils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updating existing volume attachment record: 1b7758fb-10a9-4da6-b3db-128ec7ba5500 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Successfully created port: e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:25:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Successfully updated port: e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquired lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc114dad-5301-4b39-b222-503f730268fd req-64c754ba-1749-4d05-87ab-1819345fa468 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-changed-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc114dad-5301-4b39-b222-503f730268fd req-64c754ba-1749-4d05-87ab-1819345fa468 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Refreshing instance network info cache due to event network-changed-e106eac1-ef6b-4663-b6f2-db444d8aefb6. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc114dad-5301-4b39-b222-503f730268fd req-64c754ba-1749-4d05-87ab-1819345fa468 service nova] Acquiring lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updating instance_info_cache with network_info: [{"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Releasing lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Instance network_info: |[{"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc114dad-5301-4b39-b222-503f730268fd req-64c754ba-1749-4d05-87ab-1819345fa468 service nova] Acquired lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG nova.network.neutron [req-dc114dad-5301-4b39-b222-503f730268fd req-64c754ba-1749-4d05-87ab-1819345fa468 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Refreshing network info cache for port e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:25:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:25:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-dc114dad-5301-4b39-b222-503f730268fd req-64c754ba-1749-4d05-87ab-1819345fa468 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updated VIF entry in instance network info cache for port e106eac1-ef6b-4663-b6f2-db444d8aefb6. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:25:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-dc114dad-5301-4b39-b222-503f730268fd req-64c754ba-1749-4d05-87ab-1819345fa468 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updating instance_info_cache with network_info: [{"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:25:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc114dad-5301-4b39-b222-503f730268fd req-64c754ba-1749-4d05-87ab-1819345fa468 service nova] Releasing lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:25:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:25:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:25:41 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Creating image(s)
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Ensure instance console log exists: /opt/stack/data/nova/instances/eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Start _get_guest_xml network_info=[{"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '1b7758fb-10a9-4da6-b3db-128ec7ba5500', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpqXZdIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0ea030e-6877-456c-bfe4-aaecaf996939', 'serial': 'e0ea030e-6877-456c-bfe4-aaecaf996939'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:25:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:25:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpqXZdIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:25:41 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:25:41 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:25:41 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83df33f-82d6-4121-955d-a2f6dca892fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:25:41 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b2a9b4-01ac-4b5e-9c3e-aca6820a0430]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939] added
Jul 25 10:25:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47bac30-8110-4ea8-8f90-b624d72d88c0]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fac9caa-4c8e-47b6-8433-3adb56b33429]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hpqXZdIz {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hpqXZdIz" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b7d74b-15b5-451b-bba7-13b1ce8a1b6e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hpqXZdIz'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0817c92d-0266-4d33-aea6-e5ae5fe15c6c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c19c019-95f2-4ca8-ab89-a9354481cb1f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:25:41 user nova-compute[71312]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:25:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:25:41 user nova-compute[71312]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:25:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4c74fc-ac84-4d1c-a789-037540c00289]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260]
Jul 25 10:25:41 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260] successful.
Jul 25 10:25:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9890bf-6db5-4e9a-aab0-a5e21fcd2c26]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ac2b92-d522-4fe8-a2e4-6cb8c61e408f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:25:41 user nova-compute[71312]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:25:41 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:25:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:25:42 user nova-compute[71312]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:25:42 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:25:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6de3ba4-91eb-470d-bf94-01afb70b0dfd]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpqXZdIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23232303766363261', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232303766363261', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-640868858',display_name='tempest-TestShelveInstance-server-640868858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-640868858',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqxVb5e9N0lVwsLreb6pD+UbhMUEIvVlIpx68ZdnAVOirPmGdfmeDGUtlrFHOvJWy7C0wxrN/ryaek+RqtJYd5hEh+qSczaUBpzQDtxPu/koDkoaIc0jlRLdeFsDW2MYg==',key_name='tempest-TestShelveInstance-1889794562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12bafba94e094b77a9c0a19358ab4af3',ramdisk_id='',reservation_id='r-n3bye7vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-354481259',owner_user_name='tempest-TestShelveInstance-354481259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:25:35Z,user_data=None,user_id='79d1e9b058e541babcbd999c4772e841',uuid=eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Converting VIF {"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3b:21,bridge_name='br-int',has_traffic_filtering=True,id=e106eac1-ef6b-4663-b6f2-db444d8aefb6,network=Network(026a8069-3a0d-4c92-9c23-c6a27f09272e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape106eac1-ef') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lazy-loading 'pci_devices' on Instance uuid eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:25:43 user nova-compute[71312]:   <uuid>eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338</uuid>
Jul 25 10:25:43 user nova-compute[71312]:   <name>instance-0000002c</name>
Jul 25 10:25:43 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:25:43 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:25:43 user nova-compute[71312]:   <metadata>
Jul 25 10:25:43 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:25:43 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:25:43 user nova-compute[71312]:       <nova:name>tempest-TestShelveInstance-server-640868858</nova:name>
Jul 25 10:25:43 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:25:41</nova:creationTime>
Jul 25 10:25:43 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:25:43 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:25:43 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:25:43 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:25:43 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:25:43 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:25:43 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:25:43 user nova-compute[71312]:       <nova:owner>
Jul 25 10:25:43 user nova-compute[71312]:         <nova:user uuid="79d1e9b058e541babcbd999c4772e841">tempest-TestShelveInstance-354481259-project-member</nova:user>
Jul 25 10:25:43 user nova-compute[71312]:         <nova:project uuid="12bafba94e094b77a9c0a19358ab4af3">tempest-TestShelveInstance-354481259</nova:project>
Jul 25 10:25:43 user nova-compute[71312]:       </nova:owner>
Jul 25 10:25:43 user nova-compute[71312]:       <nova:ports>
Jul 25 10:25:43 user nova-compute[71312]:         <nova:port uuid="e106eac1-ef6b-4663-b6f2-db444d8aefb6">
Jul 25 10:25:43 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:25:43 user nova-compute[71312]:         </nova:port>
Jul 25 10:25:43 user nova-compute[71312]:       </nova:ports>
Jul 25 10:25:43 user nova-compute[71312]:     </nova:instance>
Jul 25 10:25:43 user nova-compute[71312]:   </metadata>
Jul 25 10:25:43 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:25:43 user nova-compute[71312]:     <system>
Jul 25 10:25:43 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:25:43 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:25:43 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:25:43 user nova-compute[71312]:       <entry name="serial">eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338</entry>
Jul 25 10:25:43 user nova-compute[71312]:       <entry name="uuid">eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338</entry>
Jul 25 10:25:43 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:25:43 user nova-compute[71312]:     </system>
Jul 25 10:25:43 user nova-compute[71312]:   </sysinfo>
Jul 25 10:25:43 user nova-compute[71312]:   <os>
Jul 25 10:25:43 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:25:43 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:25:43 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:25:43 user nova-compute[71312]:   </os>
Jul 25 10:25:43 user nova-compute[71312]:   <features>
Jul 25 10:25:43 user nova-compute[71312]:     <acpi/>
Jul 25 10:25:43 user nova-compute[71312]:     <apic/>
Jul 25 10:25:43 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:25:43 user nova-compute[71312]:   </features>
Jul 25 10:25:43 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:25:43 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:25:43 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:25:43 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:25:43 user nova-compute[71312]:   </clock>
Jul 25 10:25:43 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:25:43 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:25:43 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:25:43 user nova-compute[71312]:   </cpu>
Jul 25 10:25:43 user nova-compute[71312]:   <devices>
Jul 25 10:25:43 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:25:43 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:25:43 user nova-compute[71312]:       <source dev="/dev/sdd"/>
Jul 25 10:25:43 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:25:43 user nova-compute[71312]:       <serial>e0ea030e-6877-456c-bfe4-aaecaf996939</serial>
Jul 25 10:25:43 user nova-compute[71312]:     </disk>
Jul 25 10:25:43 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:25:43 user nova-compute[71312]:       <mac address="fa:16:3e:a6:3b:21"/>
Jul 25 10:25:43 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:25:43 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:25:43 user nova-compute[71312]:       <target dev="tape106eac1-ef"/>
Jul 25 10:25:43 user nova-compute[71312]:     </interface>
Jul 25 10:25:43 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:25:43 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338/console.log" append="off"/>
Jul 25 10:25:43 user nova-compute[71312]:     </serial>
Jul 25 10:25:43 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:25:43 user nova-compute[71312]:     <video>
Jul 25 10:25:43 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:25:43 user nova-compute[71312]:     </video>
Jul 25 10:25:43 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:25:43 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:25:43 user nova-compute[71312]:     </rng>
Jul 25 10:25:43 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:25:43 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:25:43 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:25:43 user nova-compute[71312]:     </memballoon>
Jul 25 10:25:43 user nova-compute[71312]:   </devices>
Jul 25 10:25:43 user nova-compute[71312]: </domain>
Jul 25 10:25:43 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-640868858',display_name='tempest-TestShelveInstance-server-640868858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-640868858',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqxVb5e9N0lVwsLreb6pD+UbhMUEIvVlIpx68ZdnAVOirPmGdfmeDGUtlrFHOvJWy7C0wxrN/ryaek+RqtJYd5hEh+qSczaUBpzQDtxPu/koDkoaIc0jlRLdeFsDW2MYg==',key_name='tempest-TestShelveInstance-1889794562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12bafba94e094b77a9c0a19358ab4af3',ramdisk_id='',reservation_id='r-n3bye7vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-354481259',owner_user_name='tempest-TestShelveInstance-354481259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:25:35Z,user_data=None,user_id='79d1e9b058e541babcbd999c4772e841',uuid=eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Converting VIF {"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3b:21,bridge_name='br-int',has_traffic_filtering=True,id=e106eac1-ef6b-4663-b6f2-db444d8aefb6,network=Network(026a8069-3a0d-4c92-9c23-c6a27f09272e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape106eac1-ef') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG os_vif [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3b:21,bridge_name='br-int',has_traffic_filtering=True,id=e106eac1-ef6b-4663-b6f2-db444d8aefb6,network=Network(026a8069-3a0d-4c92-9c23-c6a27f09272e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape106eac1-ef') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape106eac1-ef, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape106eac1-ef, col_values=(('external_ids', {'iface-id': 'e106eac1-ef6b-4663-b6f2-db444d8aefb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:3b:21', 'vm-uuid': 'eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:43 user nova-compute[71312]: INFO os_vif [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3b:21,bridge_name='br-int',has_traffic_filtering=True,id=e106eac1-ef6b-4663-b6f2-db444d8aefb6,network=Network(026a8069-3a0d-4c92-9c23-c6a27f09272e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape106eac1-ef')
Jul 25 10:25:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] No VIF found with MAC fa:16:3e:a6:3b:21, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:25:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280746.570582, eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:25:46 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] VM Resumed (Lifecycle Event)
Jul 25 10:25:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-53fa8ddb-6bfd-4a61-a9f3-974c6e11ef49 req-d552000b-44e5-4575-b6d7-b2bf1b84acf5 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-53fa8ddb-6bfd-4a61-a9f3-974c6e11ef49 req-d552000b-44e5-4575-b6d7-b2bf1b84acf5 service nova] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-53fa8ddb-6bfd-4a61-a9f3-974c6e11ef49 req-d552000b-44e5-4575-b6d7-b2bf1b84acf5 service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-53fa8ddb-6bfd-4a61-a9f3-974c6e11ef49 req-d552000b-44e5-4575-b6d7-b2bf1b84acf5 service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-53fa8ddb-6bfd-4a61-a9f3-974c6e11ef49 req-d552000b-44e5-4575-b6d7-b2bf1b84acf5 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] No waiting events found dispatching network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:25:46 user nova-compute[71312]: WARNING nova.compute.manager [req-53fa8ddb-6bfd-4a61-a9f3-974c6e11ef49 req-d552000b-44e5-4575-b6d7-b2bf1b84acf5 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received unexpected event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 for instance with vm_state building and task_state spawning.
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-89d25301-636e-4586-9bfc-911c9f399ed0 req-cc41dd79-59b1-4c79-a10b-4d18d060cf97 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89d25301-636e-4586-9bfc-911c9f399ed0 req-cc41dd79-59b1-4c79-a10b-4d18d060cf97 service nova] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89d25301-636e-4586-9bfc-911c9f399ed0 req-cc41dd79-59b1-4c79-a10b-4d18d060cf97 service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89d25301-636e-4586-9bfc-911c9f399ed0 req-cc41dd79-59b1-4c79-a10b-4d18d060cf97 service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-89d25301-636e-4586-9bfc-911c9f399ed0 req-cc41dd79-59b1-4c79-a10b-4d18d060cf97 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] No waiting events found dispatching network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:25:46 user nova-compute[71312]: WARNING nova.compute.manager [req-89d25301-636e-4586-9bfc-911c9f399ed0 req-cc41dd79-59b1-4c79-a10b-4d18d060cf97 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received unexpected event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 for instance with vm_state building and task_state spawning.
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:25:46 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:25:46 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7917MB free_disk=25.00829315185547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:25:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Instance spawned successfully.
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:25:46 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280746.571966, eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:25:46 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] VM Started (Lifecycle Event)
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:25:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:25:47 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:25:47 user nova-compute[71312]: INFO nova.compute.manager [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Took 5.43 seconds to spawn the instance on the hypervisor.
Jul 25 10:25:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:25:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:25:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:25:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f7858973-7146-4229-9f41-00ebcc7618b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:25:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 411b2cee-bb2d-4b65-921c-3248c1edc454 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:25:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:25:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 19ed556d-1ecc-4252-bd17-2c8bf555f8be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:25:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:25:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:25:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:25:47 user nova-compute[71312]: INFO nova.compute.manager [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Took 13.08 seconds to build instance.
Jul 25 10:25:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2fd1423f-65ca-49ab-bd79-49b9e9231b6a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.186s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:25:47 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:25:47 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:25:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:25:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:25:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:48 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:25:48 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:25:48 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:25:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:25:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa2e1a13-da21-492a-bc10-bde1ebe0d79f req-d3a5a40b-c7af-498c-ae57-6ea540b06d5c service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Received event network-changed-b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:26:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa2e1a13-da21-492a-bc10-bde1ebe0d79f req-d3a5a40b-c7af-498c-ae57-6ea540b06d5c service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Refreshing instance network info cache due to event network-changed-b53e70b3-cc1f-457c-a38b-a984e733116e. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:26:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa2e1a13-da21-492a-bc10-bde1ebe0d79f req-d3a5a40b-c7af-498c-ae57-6ea540b06d5c service nova] Acquiring lock "refresh_cache-9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:26:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa2e1a13-da21-492a-bc10-bde1ebe0d79f req-d3a5a40b-c7af-498c-ae57-6ea540b06d5c service nova] Acquired lock "refresh_cache-9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:26:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-fa2e1a13-da21-492a-bc10-bde1ebe0d79f req-d3a5a40b-c7af-498c-ae57-6ea540b06d5c service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Refreshing network info cache for port b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:26:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-fa2e1a13-da21-492a-bc10-bde1ebe0d79f req-d3a5a40b-c7af-498c-ae57-6ea540b06d5c service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Updated VIF entry in instance network info cache for port b53e70b3-cc1f-457c-a38b-a984e733116e. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:26:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-fa2e1a13-da21-492a-bc10-bde1ebe0d79f req-d3a5a40b-c7af-498c-ae57-6ea540b06d5c service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Updating instance_info_cache with network_info: [{"id": "b53e70b3-cc1f-457c-a38b-a984e733116e", "address": "fa:16:3e:e0:f9:ce", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53e70b3-cc", "ovs_interfaceid": "b53e70b3-cc1f-457c-a38b-a984e733116e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:26:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa2e1a13-da21-492a-bc10-bde1ebe0d79f req-d3a5a40b-c7af-498c-ae57-6ea540b06d5c service nova] Releasing lock "refresh_cache-9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lazy-loading 'flavor' on Instance uuid 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:21 user nova-compute[71312]: INFO nova.compute.manager [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Attaching volume 6e52fcbb-09e4-4a84-94aa-55dd939e85f8 to /dev/vdb
Jul 25 10:26:21 user nova-compute[71312]: DEBUG os_brick.utils [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6ab3f0-76a1-4944-ac68-9de4928d3568]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d54f1c9-db43-48bb-8b29-1234e1c9b118]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8588aaf5-f2fc-4399-9a51-c0fee9332134]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5ba89b-c242-4f60-98d9-8aa312264950]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:26:21 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:26:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c03205-cdcc-4b03-807b-0a8cde931e99]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG os_brick.utils [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:26:21 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Updating existing volume attachment record: 921912fe-a684-4d22-88a0-f7ffe970ae95 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:26:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAqmZYpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:26:27 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:26:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:26:27 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:26:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:26:27 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bdc4aa-14cd-47f0-868a-4ce4f7432400]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:26:27 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[50937902-5bb4-4223-8dd7-7227f725f7e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8] added
Jul 25 10:26:27 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b73bc27-5453-49de-9e2c-08c12cbf8105]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[238968ba-5cdf-4389-9687-61e100625e4f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oAqmZYpF {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oAqmZYpF" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[220ade63-cc80-4493-a369-32bca81cadc5]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oAqmZYpF'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f5e24f-bbaf-497d-a7c3-83753e4036f7]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4c1137-5516-40cc-a2d8-1d804bc22c8f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:26:27 user nova-compute[71312]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:26:27 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:26:27 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:26:27 user nova-compute[71312]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:26:27 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:26:27 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:26:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0839c6bc-def0-468f-abec-3e79b93f13b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8, portal: 172.16.0.220,3260]
Jul 25 10:26:28 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8, portal: 172.16.0.220,3260] successful.
Jul 25 10:26:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d19713a-c71c-4131-a050-30cec4309483]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90c7cb9-a858-40e9-ae16-83dcfcf9a7fa]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:26:28 user nova-compute[71312]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:26:28 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:26:28 user nova-compute[71312]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 (non-flash)
Jul 25 10:26:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:26:28 user nova-compute[71312]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:26:28 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:26:28 user nova-compute[71312]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 (non-flash)
Jul 25 10:26:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b259c23-40be-42ce-a95a-8a942f7a26c8]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAqmZYpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:26:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:26:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26132643163666139', 'path': '/dev/sde'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:26:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132643163666139', 'path': '/dev/sde'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:26:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lazy-loading 'flavor' on Instance uuid 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:26:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:26:29 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:26:29 user nova-compute[71312]:   <source dev="/dev/sde"/>
Jul 25 10:26:29 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:26:29 user nova-compute[71312]:   <serial>6e52fcbb-09e4-4a84-94aa-55dd939e85f8</serial>
Jul 25 10:26:29 user nova-compute[71312]: </disk>
Jul 25 10:26:29 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:26:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:26:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:26:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] No VIF found with MAC fa:16:3e:e0:f9:ce, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:26:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1c76a814-bc27-40e7-b4bd-c1c1b43ae58c tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.552s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:32 user nova-compute[71312]: INFO nova.compute.manager [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Detaching volume 6e52fcbb-09e4-4a84-94aa-55dd939e85f8
Jul 25 10:26:32 user nova-compute[71312]: INFO nova.virt.block_device [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Attempting to driver detach volume 6e52fcbb-09e4-4a84-94aa-55dd939e85f8 from mountpoint /dev/vdb
Jul 25 10:26:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Attempting to detach device vdb from instance 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:26:32 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:26:32 user nova-compute[71312]:   <source dev="/dev/sde"/>
Jul 25 10:26:32 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:26:32 user nova-compute[71312]:   <serial>6e52fcbb-09e4-4a84-94aa-55dd939e85f8</serial>
Jul 25 10:26:32 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:26:32 user nova-compute[71312]: </disk>
Jul 25 10:26:32 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:26:32 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Successfully detached device vdb from instance 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b from the persistent domain config.
Jul 25 10:26:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:26:32 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:26:32 user nova-compute[71312]:   <source dev="/dev/sde"/>
Jul 25 10:26:32 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:26:32 user nova-compute[71312]:   <serial>6e52fcbb-09e4-4a84-94aa-55dd939e85f8</serial>
Jul 25 10:26:32 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:26:32 user nova-compute[71312]: </disk>
Jul 25 10:26:32 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690280792.5080733, 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:26:32 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Successfully detached device vdb from instance 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b from the live domain config.
Jul 25 10:26:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAqmZYpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:26:32 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3462e82-bc32-4df1-b265-b8128bd29344]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:26:32 user nova-compute[71312]: No targets found.
Jul 25 10:26:32 user nova-compute[71312]: iSNS:
Jul 25 10:26:32 user nova-compute[71312]: No targets found.
Jul 25 10:26:32 user nova-compute[71312]: STATIC:
Jul 25 10:26:32 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3
Jul 25 10:26:32 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:26:32 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:26:32 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b
Jul 25 10:26:32 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:26:32 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:26:32 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939
Jul 25 10:26:32 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:26:32 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:26:32 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8
Jul 25 10:26:32 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:26:32 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:26:32 user nova-compute[71312]: FIRMWARE:
Jul 25 10:26:32 user nova-compute[71312]: No targets found.
Jul 25 10:26:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:26:32 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:26:32 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03e7155-e969-47f5-ac5c-a7d989d48f3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5432b0-3cca-4a76-aadd-766f1f42c617]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:26:32 user nova-compute[71312]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:26:32 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:26:32 user nova-compute[71312]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 (non-flash)
Jul 25 10:26:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:26:32 user nova-compute[71312]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:26:32 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:26:32 user nova-compute[71312]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 (non-flash)
Jul 25 10:26:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a8621d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8'): ({'sde'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Removing single pathed devices sde {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f56346-b8b6-42ed-a33b-768c660fe5d5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[be30853c-6559-41b7-be47-6dcf1e3def59]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Flushing IO for device /dev/sde {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b96e1b-a7d4-4ea9-bf9b-87d77ab8f851]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[37837448-0221-4b9c-8d67-62c8d70d27b2]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60bca16-d1b7-4e9b-bbc1-16c1e134d6bd]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86965b4-4215-43fe-a4f6-855e7ebf73f9]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8, portal: 172.16.0.220,3260]
Jul 25 10:26:32 user nova-compute[71312]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8, portal: 172.16.0.220,3260] successful.
Jul 25 10:26:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e52fcbb-09e4-4a84-94aa-55dd939e85f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be8e246-4982-484e-94e2-b13ac38adcae]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] <== disconnect_volume: return (301ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:26:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:26:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:33 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lazy-loading 'flavor' on Instance uuid 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:26:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c24a7269-4ac5-4fa1-b8e1-477c75835629 tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.576s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:26:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:26:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:26:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:26:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:26:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updating instance_info_cache with network_info: [{"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:26:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:26:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:26:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:26:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:26:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:26:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:26:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:26:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-8fc40958-5d0c-4865-a543-17c991b1dcec req-2b37f185-5975-49a6-9d3b-a7f3838a8abc service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received event network-changed-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:26:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-8fc40958-5d0c-4865-a543-17c991b1dcec req-2b37f185-5975-49a6-9d3b-a7f3838a8abc service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Refreshing instance network info cache due to event network-changed-559eef7f-1e5c-4d3b-968a-4196be42f303. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:26:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8fc40958-5d0c-4865-a543-17c991b1dcec req-2b37f185-5975-49a6-9d3b-a7f3838a8abc service nova] Acquiring lock "refresh_cache-19ed556d-1ecc-4252-bd17-2c8bf555f8be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:26:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8fc40958-5d0c-4865-a543-17c991b1dcec req-2b37f185-5975-49a6-9d3b-a7f3838a8abc service nova] Acquired lock "refresh_cache-19ed556d-1ecc-4252-bd17-2c8bf555f8be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:26:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-8fc40958-5d0c-4865-a543-17c991b1dcec req-2b37f185-5975-49a6-9d3b-a7f3838a8abc service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Refreshing network info cache for port 559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:26:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-8fc40958-5d0c-4865-a543-17c991b1dcec req-2b37f185-5975-49a6-9d3b-a7f3838a8abc service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Updated VIF entry in instance network info cache for port 559eef7f-1e5c-4d3b-968a-4196be42f303. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:26:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-8fc40958-5d0c-4865-a543-17c991b1dcec req-2b37f185-5975-49a6-9d3b-a7f3838a8abc service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Updating instance_info_cache with network_info: [{"id": "559eef7f-1e5c-4d3b-968a-4196be42f303", "address": "fa:16:3e:1f:c6:a5", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559eef7f-1e", "ovs_interfaceid": "559eef7f-1e5c-4d3b-968a-4196be42f303", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:26:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8fc40958-5d0c-4865-a543-17c991b1dcec req-2b37f185-5975-49a6-9d3b-a7f3838a8abc service nova] Releasing lock "refresh_cache-19ed556d-1ecc-4252-bd17-2c8bf555f8be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:26:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:26:38 user nova-compute[71312]: INFO nova.compute.claims [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Claim successful on node user
Jul 25 10:26:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:26:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:26:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG nova.policy [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc43767776ce4c9daf58530d543b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce6203d47944c3cb5bca9ab1c173192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:26:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Creating image(s)
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "/opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "/opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "/opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk 1073741824" returned: 0 in 0.057s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:39 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:26:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Successfully created port: e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:26:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:39 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Cannot resize image /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:26:39 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'migration_context' on Instance uuid 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:26:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:26:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Ensure instance console log exists: /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:26:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Successfully updated port: e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquired lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-aaa9948c-5cc2-468e-a3d6-4d3384c87d3b req-81c11306-c075-49a9-bcb7-db3a1084566f service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-changed-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-aaa9948c-5cc2-468e-a3d6-4d3384c87d3b req-81c11306-c075-49a9-bcb7-db3a1084566f service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Refreshing instance network info cache due to event network-changed-e682c004-dec6-4b49-8eed-ae0ea3306002. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-aaa9948c-5cc2-468e-a3d6-4d3384c87d3b req-81c11306-c075-49a9-bcb7-db3a1084566f service nova] Acquiring lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updating instance_info_cache with network_info: [{"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Releasing lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Instance network_info: |[{"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-aaa9948c-5cc2-468e-a3d6-4d3384c87d3b req-81c11306-c075-49a9-bcb7-db3a1084566f service nova] Acquired lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-aaa9948c-5cc2-468e-a3d6-4d3384c87d3b req-81c11306-c075-49a9-bcb7-db3a1084566f service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Refreshing network info cache for port e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Start _get_guest_xml network_info=[{"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:26:40 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:26:40 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1594314963',display_name='tempest-ServerRescueNegativeTestJSON-server-1594314963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1594314963',id=45,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOTw7aSa7h6F/7uKhiDwBlWmJ/sSN7kzsYFrKGR2yh+kin3WzbjCfyDSfskAkmTJV+Aku8s4Q+WazWOnHFLbvcdqaGEVOZTQJn2O8d0oEKEycJI7JVT0wfMRFACKD+Heg==',key_name='tempest-keypair-1613082722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce6203d47944c3cb5bca9ab1c173192',ramdisk_id='',reservation_id='r-y9ab5bji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1328366493',owner_user_name='tempest-ServerRescueNegativeTestJSON-1328366493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc43767776ce4c9daf58530d543b0e3f',uuid=8838dac5-9f12-4e01-9367-ad184cbc00b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converting VIF {"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:cc:58,bridge_name='br-int',has_traffic_filtering=True,id=e682c004-dec6-4b49-8eed-ae0ea3306002,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape682c004-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'pci_devices' on Instance uuid 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:26:40 user nova-compute[71312]:   <uuid>8838dac5-9f12-4e01-9367-ad184cbc00b6</uuid>
Jul 25 10:26:40 user nova-compute[71312]:   <name>instance-0000002d</name>
Jul 25 10:26:40 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:26:40 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:26:40 user nova-compute[71312]:   <metadata>
Jul 25 10:26:40 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:26:40 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:26:40 user nova-compute[71312]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1594314963</nova:name>
Jul 25 10:26:40 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:26:40</nova:creationTime>
Jul 25 10:26:40 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:26:40 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:26:40 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:26:40 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:26:40 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:26:40 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:26:40 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:26:40 user nova-compute[71312]:       <nova:owner>
Jul 25 10:26:40 user nova-compute[71312]:         <nova:user uuid="fc43767776ce4c9daf58530d543b0e3f">tempest-ServerRescueNegativeTestJSON-1328366493-project-member</nova:user>
Jul 25 10:26:40 user nova-compute[71312]:         <nova:project uuid="3ce6203d47944c3cb5bca9ab1c173192">tempest-ServerRescueNegativeTestJSON-1328366493</nova:project>
Jul 25 10:26:40 user nova-compute[71312]:       </nova:owner>
Jul 25 10:26:40 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:26:40 user nova-compute[71312]:       <nova:ports>
Jul 25 10:26:40 user nova-compute[71312]:         <nova:port uuid="e682c004-dec6-4b49-8eed-ae0ea3306002">
Jul 25 10:26:40 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 25 10:26:40 user nova-compute[71312]:         </nova:port>
Jul 25 10:26:40 user nova-compute[71312]:       </nova:ports>
Jul 25 10:26:40 user nova-compute[71312]:     </nova:instance>
Jul 25 10:26:40 user nova-compute[71312]:   </metadata>
Jul 25 10:26:40 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:26:40 user nova-compute[71312]:     <system>
Jul 25 10:26:40 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:26:40 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:26:40 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:26:40 user nova-compute[71312]:       <entry name="serial">8838dac5-9f12-4e01-9367-ad184cbc00b6</entry>
Jul 25 10:26:40 user nova-compute[71312]:       <entry name="uuid">8838dac5-9f12-4e01-9367-ad184cbc00b6</entry>
Jul 25 10:26:40 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:26:40 user nova-compute[71312]:     </system>
Jul 25 10:26:40 user nova-compute[71312]:   </sysinfo>
Jul 25 10:26:40 user nova-compute[71312]:   <os>
Jul 25 10:26:40 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:26:40 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:26:40 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:26:40 user nova-compute[71312]:   </os>
Jul 25 10:26:40 user nova-compute[71312]:   <features>
Jul 25 10:26:40 user nova-compute[71312]:     <acpi/>
Jul 25 10:26:40 user nova-compute[71312]:     <apic/>
Jul 25 10:26:40 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:26:40 user nova-compute[71312]:   </features>
Jul 25 10:26:40 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:26:40 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:26:40 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:26:40 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:26:40 user nova-compute[71312]:   </clock>
Jul 25 10:26:40 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:26:40 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:26:40 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:26:40 user nova-compute[71312]:   </cpu>
Jul 25 10:26:40 user nova-compute[71312]:   <devices>
Jul 25 10:26:40 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:26:40 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:26:40 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk"/>
Jul 25 10:26:40 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:26:40 user nova-compute[71312]:     </disk>
Jul 25 10:26:40 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:26:40 user nova-compute[71312]:       <mac address="fa:16:3e:b0:cc:58"/>
Jul 25 10:26:40 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:26:40 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:26:40 user nova-compute[71312]:       <target dev="tape682c004-de"/>
Jul 25 10:26:40 user nova-compute[71312]:     </interface>
Jul 25 10:26:40 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:26:40 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/console.log" append="off"/>
Jul 25 10:26:40 user nova-compute[71312]:     </serial>
Jul 25 10:26:40 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:26:40 user nova-compute[71312]:     <video>
Jul 25 10:26:40 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:26:40 user nova-compute[71312]:     </video>
Jul 25 10:26:40 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:26:40 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:26:40 user nova-compute[71312]:     </rng>
Jul 25 10:26:40 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:26:40 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:26:40 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:26:40 user nova-compute[71312]:     </memballoon>
Jul 25 10:26:40 user nova-compute[71312]:   </devices>
Jul 25 10:26:40 user nova-compute[71312]: </domain>
Jul 25 10:26:40 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1594314963',display_name='tempest-ServerRescueNegativeTestJSON-server-1594314963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1594314963',id=45,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOTw7aSa7h6F/7uKhiDwBlWmJ/sSN7kzsYFrKGR2yh+kin3WzbjCfyDSfskAkmTJV+Aku8s4Q+WazWOnHFLbvcdqaGEVOZTQJn2O8d0oEKEycJI7JVT0wfMRFACKD+Heg==',key_name='tempest-keypair-1613082722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce6203d47944c3cb5bca9ab1c173192',ramdisk_id='',reservation_id='r-y9ab5bji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1328366493',owner_user_name='tempest-ServerRescueNegativeTestJSON-1328366493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc43767776ce4c9daf58530d543b0e3f',uuid=8838dac5-9f12-4e01-9367-ad184cbc00b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converting VIF {"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:cc:58,bridge_name='br-int',has_traffic_filtering=True,id=e682c004-dec6-4b49-8eed-ae0ea3306002,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape682c004-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG os_vif [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:cc:58,bridge_name='br-int',has_traffic_filtering=True,id=e682c004-dec6-4b49-8eed-ae0ea3306002,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape682c004-de') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape682c004-de, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape682c004-de, col_values=(('external_ids', {'iface-id': 'e682c004-dec6-4b49-8eed-ae0ea3306002', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:cc:58', 'vm-uuid': '8838dac5-9f12-4e01-9367-ad184cbc00b6'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:40 user nova-compute[71312]: INFO os_vif [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:cc:58,bridge_name='br-int',has_traffic_filtering=True,id=e682c004-dec6-4b49-8eed-ae0ea3306002,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape682c004-de')
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No VIF found with MAC fa:16:3e:b0:cc:58, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-aaa9948c-5cc2-468e-a3d6-4d3384c87d3b req-81c11306-c075-49a9-bcb7-db3a1084566f service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updated VIF entry in instance network info cache for port e682c004-dec6-4b49-8eed-ae0ea3306002. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-aaa9948c-5cc2-468e-a3d6-4d3384c87d3b req-81c11306-c075-49a9-bcb7-db3a1084566f service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updating instance_info_cache with network_info: [{"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:26:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-aaa9948c-5cc2-468e-a3d6-4d3384c87d3b req-81c11306-c075-49a9-bcb7-db3a1084566f service nova] Releasing lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:26:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-eea7c569-2475-4575-a888-bb53768ce147 req-07b90e24-b266-414a-91c0-c0cc4417c0c4 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:26:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eea7c569-2475-4575-a888-bb53768ce147 req-07b90e24-b266-414a-91c0-c0cc4417c0c4 service nova] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eea7c569-2475-4575-a888-bb53768ce147 req-07b90e24-b266-414a-91c0-c0cc4417c0c4 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eea7c569-2475-4575-a888-bb53768ce147 req-07b90e24-b266-414a-91c0-c0cc4417c0c4 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-eea7c569-2475-4575-a888-bb53768ce147 req-07b90e24-b266-414a-91c0-c0cc4417c0c4 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] No waiting events found dispatching network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:26:42 user nova-compute[71312]: WARNING nova.compute.manager [req-eea7c569-2475-4575-a888-bb53768ce147 req-07b90e24-b266-414a-91c0-c0cc4417c0c4 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received unexpected event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 for instance with vm_state building and task_state spawning.
Jul 25 10:26:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:26:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:42 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280804.1156108, 8838dac5-9f12-4e01-9367-ad184cbc00b6 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:26:44 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] VM Resumed (Lifecycle Event)
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:26:44 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Instance spawned successfully.
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:26:44 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280804.1273665, 8838dac5-9f12-4e01-9367-ad184cbc00b6 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:26:44 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] VM Started (Lifecycle Event)
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:26:44 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:26:44 user nova-compute[71312]: INFO nova.compute.manager [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Took 5.67 seconds to spawn the instance on the hypervisor.
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:44 user nova-compute[71312]: INFO nova.compute.manager [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Took 6.45 seconds to build instance.
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e888171a-2d81-4dc4-a58e-da965fb4c9e4 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.536s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-5acb81b6-e0f6-4309-89e2-35aa307a3e6b req-9de27b7f-f00e-4c85-9636-4d99ac3e1c58 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5acb81b6-e0f6-4309-89e2-35aa307a3e6b req-9de27b7f-f00e-4c85-9636-4d99ac3e1c58 service nova] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5acb81b6-e0f6-4309-89e2-35aa307a3e6b req-9de27b7f-f00e-4c85-9636-4d99ac3e1c58 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5acb81b6-e0f6-4309-89e2-35aa307a3e6b req-9de27b7f-f00e-4c85-9636-4d99ac3e1c58 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-5acb81b6-e0f6-4309-89e2-35aa307a3e6b req-9de27b7f-f00e-4c85-9636-4d99ac3e1c58 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] No waiting events found dispatching network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:26:44 user nova-compute[71312]: WARNING nova.compute.manager [req-5acb81b6-e0f6-4309-89e2-35aa307a3e6b req-9de27b7f-f00e-4c85-9636-4d99ac3e1c58 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received unexpected event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 for instance with vm_state active and task_state None.
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-522da897-5709-4e1e-b228-12e18a3852a4 req-285218cb-a0ce-4d8a-8177-e0f4baaeff15 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-changed-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-522da897-5709-4e1e-b228-12e18a3852a4 req-285218cb-a0ce-4d8a-8177-e0f4baaeff15 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Refreshing instance network info cache due to event network-changed-21c48988-5022-49f7-baa0-a10dfdc879bd. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-522da897-5709-4e1e-b228-12e18a3852a4 req-285218cb-a0ce-4d8a-8177-e0f4baaeff15 service nova] Acquiring lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-522da897-5709-4e1e-b228-12e18a3852a4 req-285218cb-a0ce-4d8a-8177-e0f4baaeff15 service nova] Acquired lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG nova.network.neutron [req-522da897-5709-4e1e-b228-12e18a3852a4 req-285218cb-a0ce-4d8a-8177-e0f4baaeff15 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Refreshing network info cache for port 21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:45 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:26:45 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:26:45 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7897MB free_disk=25.00507354736328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "abdc34b5-ca82-4d14-8413-e254897676fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "abdc34b5-ca82-4d14-8413-e254897676fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f7858973-7146-4229-9f41-00ebcc7618b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 411b2cee-bb2d-4b65-921c-3248c1edc454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 19ed556d-1ecc-4252-bd17-2c8bf555f8be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8838dac5-9f12-4e01-9367-ad184cbc00b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance abdc34b5-ca82-4d14-8413-e254897676fd has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1724}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing inventories for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Updating ProviderTree inventory for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Updating inventory in ProviderTree for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-522da897-5709-4e1e-b228-12e18a3852a4 req-285218cb-a0ce-4d8a-8177-e0f4baaeff15 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updated VIF entry in instance network info cache for port 21c48988-5022-49f7-baa0-a10dfdc879bd. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-522da897-5709-4e1e-b228-12e18a3852a4 req-285218cb-a0ce-4d8a-8177-e0f4baaeff15 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updating instance_info_cache with network_info: [{"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing aggregate associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-522da897-5709-4e1e-b228-12e18a3852a4 req-285218cb-a0ce-4d8a-8177-e0f4baaeff15 service nova] Releasing lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing trait associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, traits: COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:46 user nova-compute[71312]: INFO nova.compute.manager [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Detaching volume c3968fd3-3a2f-441c-aa7d-22623ad4240b
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:26:46 user nova-compute[71312]: INFO nova.virt.block_device [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Attempting to driver detach volume c3968fd3-3a2f-441c-aa7d-22623ad4240b from mountpoint /dev/vdb
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.807s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.518s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Attempting to detach device vdb from instance 411b2cee-bb2d-4b65-921c-3248c1edc454 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:26:46 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:26:46 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Jul 25 10:26:46 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:26:46 user nova-compute[71312]:   <serial>c3968fd3-3a2f-441c-aa7d-22623ad4240b</serial>
Jul 25 10:26:46 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 10:26:46 user nova-compute[71312]: </disk>
Jul 25 10:26:46 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:26:46 user nova-compute[71312]: INFO nova.compute.claims [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Claim successful on node user
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 10:26:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Successfully detached device vdb from instance 411b2cee-bb2d-4b65-921c-3248c1edc454 from the persistent domain config.
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 411b2cee-bb2d-4b65-921c-3248c1edc454 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:26:46 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:26:46 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Jul 25 10:26:46 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:26:46 user nova-compute[71312]:   <serial>c3968fd3-3a2f-441c-aa7d-22623ad4240b</serial>
Jul 25 10:26:46 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 10:26:46 user nova-compute[71312]: </disk>
Jul 25 10:26:46 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690280807.0077686, 411b2cee-bb2d-4b65-921c-3248c1edc454 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 411b2cee-bb2d-4b65-921c-3248c1edc454 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:26:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Successfully detached device vdb from instance 411b2cee-bb2d-4b65-921c-3248c1edc454 from the live domain config.
Jul 25 10:26:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TExdpjmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:26:47 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:26:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae829ec3-647f-42b8-a702-bf237558c4dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:26:47 user nova-compute[71312]: No targets found.
Jul 25 10:26:47 user nova-compute[71312]: iSNS:
Jul 25 10:26:47 user nova-compute[71312]: No targets found.
Jul 25 10:26:47 user nova-compute[71312]: STATIC:
Jul 25 10:26:47 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3
Jul 25 10:26:47 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:26:47 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:26:47 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b
Jul 25 10:26:47 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:26:47 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:26:47 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939
Jul 25 10:26:47 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:26:47 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:26:47 user nova-compute[71312]: FIRMWARE:
Jul 25 10:26:47 user nova-compute[71312]: No targets found.
Jul 25 10:26:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:26:47 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:26:47 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef0bc99-8754-4917-8e9b-c6bdb5e36a4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d50aff4-742a-4585-8c9d-372c218d380d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:26:47 user nova-compute[71312]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:26:47 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:26:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:26:47 user nova-compute[71312]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b (non-flash)
Jul 25 10:26:47 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:26:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a82f00d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:47 user nova-compute[71312]: INFO nova.virt.block_device [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Booting with volume snapshot d4a795bc-cb7f-42f0-aee1-329c0e1499b5 at /dev/vda
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ed5abb-5a4a-4d6b-bfe2-c82395e0354d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG nova.policy [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b15229b8fb22457ca38b9c5bf2f6dbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55fc0544c744824b3b999ecfcf11e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c645134-f0dd-4bc3-a22b-f7294002707e]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0bd551-1d0e-4ea3-bb24-a3c9eb958a99]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-7034fe5b-c855-4d9a-8a75-9817581bbfd5 req-89581e02-7173-4da5-a4fa-33cbaa163f97 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-changed-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-7034fe5b-c855-4d9a-8a75-9817581bbfd5 req-89581e02-7173-4da5-a4fa-33cbaa163f97 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Refreshing instance network info cache due to event network-changed-21c48988-5022-49f7-baa0-a10dfdc879bd. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7034fe5b-c855-4d9a-8a75-9817581bbfd5 req-89581e02-7173-4da5-a4fa-33cbaa163f97 service nova] Acquiring lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7034fe5b-c855-4d9a-8a75-9817581bbfd5 req-89581e02-7173-4da5-a4fa-33cbaa163f97 service nova] Acquired lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-7034fe5b-c855-4d9a-8a75-9817581bbfd5 req-89581e02-7173-4da5-a4fa-33cbaa163f97 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Refreshing network info cache for port 21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3156ab0b-7297-47e5-9ab3-bb8b25e2c40a]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[243dad8a-8cde-4add-a822-6a274dfc0723]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9125f263-71bc-44ea-94a1-f214f7213467]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260]
Jul 25 10:26:47 user nova-compute[71312]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b, portal: 172.16.0.220,3260] successful.
Jul 25 10:26:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3968fd3-3a2f-441c-aa7d-22623ad4240b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0f8ab4-fd6b-4999-954a-a8fed6639a4a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] <== disconnect_volume: return (415ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-7034fe5b-c855-4d9a-8a75-9817581bbfd5 req-89581e02-7173-4da5-a4fa-33cbaa163f97 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updated VIF entry in instance network info cache for port 21c48988-5022-49f7-baa0-a10dfdc879bd. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-7034fe5b-c855-4d9a-8a75-9817581bbfd5 req-89581e02-7173-4da5-a4fa-33cbaa163f97 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updating instance_info_cache with network_info: [{"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7034fe5b-c855-4d9a-8a75-9817581bbfd5 req-89581e02-7173-4da5-a4fa-33cbaa163f97 service nova] Releasing lock "refresh_cache-411b2cee-bb2d-4b65-921c-3248c1edc454" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:26:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Successfully created port: 0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:26:48 user nova-compute[71312]: DEBUG nova.objects.instance [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'flavor' on Instance uuid 411b2cee-bb2d-4b65-921c-3248c1edc454 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:26:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-92e3d90f-0043-4a7f-bce4-9b201dff5d43 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.894s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Successfully updated port: 0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:26:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "refresh_cache-abdc34b5-ca82-4d14-8413-e254897676fd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:26:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquired lock "refresh_cache-abdc34b5-ca82-4d14-8413-e254897676fd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:26:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:26:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-8fdb851a-ed63-43f4-a1d4-6b1b604fe470 req-9e55b3f0-6caa-492c-96c7-2e1938b92c0d service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Received event network-changed-0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:26:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-8fdb851a-ed63-43f4-a1d4-6b1b604fe470 req-9e55b3f0-6caa-492c-96c7-2e1938b92c0d service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Refreshing instance network info cache due to event network-changed-0aab3747-d4f0-4905-8649-ba13ab4d81b8. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:26:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8fdb851a-ed63-43f4-a1d4-6b1b604fe470 req-9e55b3f0-6caa-492c-96c7-2e1938b92c0d service nova] Acquiring lock "refresh_cache-abdc34b5-ca82-4d14-8413-e254897676fd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:26:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:26:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Updating instance_info_cache with network_info: [{"id": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "address": "fa:16:3e:99:97:0c", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aab3747-d4", "ovs_interfaceid": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:26:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Releasing lock "refresh_cache-abdc34b5-ca82-4d14-8413-e254897676fd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:26:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Instance network_info: |[{"id": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "address": "fa:16:3e:99:97:0c", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aab3747-d4", "ovs_interfaceid": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:26:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8fdb851a-ed63-43f4-a1d4-6b1b604fe470 req-9e55b3f0-6caa-492c-96c7-2e1938b92c0d service nova] Acquired lock "refresh_cache-abdc34b5-ca82-4d14-8413-e254897676fd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:26:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-8fdb851a-ed63-43f4-a1d4-6b1b604fe470 req-9e55b3f0-6caa-492c-96c7-2e1938b92c0d service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Refreshing network info cache for port 0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:26:50 user nova-compute[71312]: DEBUG nova.network.neutron [req-8fdb851a-ed63-43f4-a1d4-6b1b604fe470 req-9e55b3f0-6caa-492c-96c7-2e1938b92c0d service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Updated VIF entry in instance network info cache for port 0aab3747-d4f0-4905-8649-ba13ab4d81b8. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:26:50 user nova-compute[71312]: DEBUG nova.network.neutron [req-8fdb851a-ed63-43f4-a1d4-6b1b604fe470 req-9e55b3f0-6caa-492c-96c7-2e1938b92c0d service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Updating instance_info_cache with network_info: [{"id": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "address": "fa:16:3e:99:97:0c", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aab3747-d4", "ovs_interfaceid": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:26:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8fdb851a-ed63-43f4-a1d4-6b1b604fe470 req-9e55b3f0-6caa-492c-96c7-2e1938b92c0d service nova] Releasing lock "refresh_cache-abdc34b5-ca82-4d14-8413-e254897676fd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:26:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:26:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:26:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 10:26:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG os_brick.utils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e477de67-6b77-4fc9-a676-68690932c834]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[63069f32-b845-479e-bebf-4670dabb5f44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aec4457-413d-4e61-a438-beea8ff4a284]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2238f1-aa3c-421c-b170-3cdc9110611b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:26:52 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:26:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e32bc7-4a0b-40fd-a84f-6d8f1fdbfcf7]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG os_brick.utils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:26:52 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Updating existing volume attachment record: 88e025ac-15bf-4125-a29e-4d80176bc296 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:26:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:26:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Creating image(s)
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Ensure instance console log exists: /opt/stack/data/nova/instances/abdc34b5-ca82-4d14-8413-e254897676fd/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Start _get_guest_xml network_info=[{"id": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "address": "fa:16:3e:99:97:0c", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aab3747-d4", "ovs_interfaceid": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-25T10:26:39Z,direct_url=<?>,disk_format='qcow2',id=1246d48d-a0e0-4ebb-9cc5-51b86c27ef9a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-569735606',owner='e55fc0544c744824b3b999ecfcf11e31',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-25T10:26:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '88e025ac-15bf-4125-a29e-4d80176bc296', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqSEhaBk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'abdc34b5-ca82-4d14-8413-e254897676fd', 'attached_at': '', 'detached_at': '', 'volume_id': '668f4c99-6670-445e-827d-120884481ae4', 'serial': '668f4c99-6670-445e-827d-120884481ae4'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:26:59 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:26:59 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-25T10:26:39Z,direct_url=<?>,disk_format='qcow2',id=1246d48d-a0e0-4ebb-9cc5-51b86c27ef9a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-569735606',owner='e55fc0544c744824b3b999ecfcf11e31',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-25T10:26:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqSEhaBk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:26:59 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:26:59 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:26:59 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09b0988-b096-4968-8381-0f26d5aab6cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:26:59 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cc8ab9-e0cc-4d9b-ae78-c5a6733c925b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4] added
Jul 25 10:26:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd874d7-34ef-4990-a876-a490a7807bbe]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0ef661-e756-4eac-997b-508bffbfbfa8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqSEhaBk {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqSEhaBk" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc17fc2-f1d6-4498-8cf9-cb02cf8cc052]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iqSEhaBk'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c797e16d-5ec4-4b27-a777-f2587a98b767]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf372392-3c3e-4486-b602-bdffae4d0e2f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:26:59 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:26:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:26:59 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:26:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a39bb1c-1819-41ce-aadc-959902edf24c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4, portal: 172.16.0.220,3260]
Jul 25 10:26:59 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4, portal: 172.16.0.220,3260] successful.
Jul 25 10:26:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[966e0aa3-ce48-40ae-89a1-f26c3be53ab1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4750eca-df8e-4b5a-b4f3-afe28e53571d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:26:59 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:26:59 user nova-compute[71312]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)
Jul 25 10:26:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:26:59 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:26:59 user nova-compute[71312]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)
Jul 25 10:26:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab494db-d150-46ee-8f13-948d08203441]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:26:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqSEhaBk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23430633666343561', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430633666343561', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:26:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1142318536',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1142318536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1142318536',id=46,image_ref='1246d48d-a0e0-4ebb-9cc5-51b86c27ef9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZN4iQ3YQZhR/MeNRJNqHF5LW4qaD8ZHCD/KGKnzXrMtV+Pd4EsK+hxZF9+n5ULs3sGsyGtUdwgs06RVm1xpOUHV/0hSX5/81ssmGdzmWAhP46mq+aHbGnxehJXLauwCw==',key_name='tempest-keypair-1194129302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-hht84cps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-614700428',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:26:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=abdc34b5-ca82-4d14-8413-e254897676fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "address": "fa:16:3e:99:97:0c", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aab3747-d4", "ovs_interfaceid": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "address": "fa:16:3e:99:97:0c", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aab3747-d4", "ovs_interfaceid": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:97:0c,bridge_name='br-int',has_traffic_filtering=True,id=0aab3747-d4f0-4905-8649-ba13ab4d81b8,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aab3747-d4') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lazy-loading 'pci_devices' on Instance uuid abdc34b5-ca82-4d14-8413-e254897676fd {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:27:00 user nova-compute[71312]:   <uuid>abdc34b5-ca82-4d14-8413-e254897676fd</uuid>
Jul 25 10:27:00 user nova-compute[71312]:   <name>instance-0000002e</name>
Jul 25 10:27:00 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:27:00 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:27:00 user nova-compute[71312]:   <metadata>
Jul 25 10:27:00 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:27:00 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:27:00 user nova-compute[71312]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1142318536</nova:name>
Jul 25 10:27:00 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:26:59</nova:creationTime>
Jul 25 10:27:00 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:27:00 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:27:00 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:27:00 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:27:00 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:27:00 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:27:00 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:27:00 user nova-compute[71312]:       <nova:owner>
Jul 25 10:27:00 user nova-compute[71312]:         <nova:user uuid="b15229b8fb22457ca38b9c5bf2f6dbc3">tempest-TestVolumeBootPattern-614700428-project-member</nova:user>
Jul 25 10:27:00 user nova-compute[71312]:         <nova:project uuid="e55fc0544c744824b3b999ecfcf11e31">tempest-TestVolumeBootPattern-614700428</nova:project>
Jul 25 10:27:00 user nova-compute[71312]:       </nova:owner>
Jul 25 10:27:00 user nova-compute[71312]:       <nova:root type="image" uuid="1246d48d-a0e0-4ebb-9cc5-51b86c27ef9a"/>
Jul 25 10:27:00 user nova-compute[71312]:       <nova:ports>
Jul 25 10:27:00 user nova-compute[71312]:         <nova:port uuid="0aab3747-d4f0-4905-8649-ba13ab4d81b8">
Jul 25 10:27:00 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 25 10:27:00 user nova-compute[71312]:         </nova:port>
Jul 25 10:27:00 user nova-compute[71312]:       </nova:ports>
Jul 25 10:27:00 user nova-compute[71312]:     </nova:instance>
Jul 25 10:27:00 user nova-compute[71312]:   </metadata>
Jul 25 10:27:00 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:27:00 user nova-compute[71312]:     <system>
Jul 25 10:27:00 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:27:00 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:27:00 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:27:00 user nova-compute[71312]:       <entry name="serial">abdc34b5-ca82-4d14-8413-e254897676fd</entry>
Jul 25 10:27:00 user nova-compute[71312]:       <entry name="uuid">abdc34b5-ca82-4d14-8413-e254897676fd</entry>
Jul 25 10:27:00 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:27:00 user nova-compute[71312]:     </system>
Jul 25 10:27:00 user nova-compute[71312]:   </sysinfo>
Jul 25 10:27:00 user nova-compute[71312]:   <os>
Jul 25 10:27:00 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:27:00 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:27:00 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:27:00 user nova-compute[71312]:   </os>
Jul 25 10:27:00 user nova-compute[71312]:   <features>
Jul 25 10:27:00 user nova-compute[71312]:     <acpi/>
Jul 25 10:27:00 user nova-compute[71312]:     <apic/>
Jul 25 10:27:00 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:27:00 user nova-compute[71312]:   </features>
Jul 25 10:27:00 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:27:00 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:27:00 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:27:00 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:27:00 user nova-compute[71312]:   </clock>
Jul 25 10:27:00 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:27:00 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:27:00 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:27:00 user nova-compute[71312]:   </cpu>
Jul 25 10:27:00 user nova-compute[71312]:   <devices>
Jul 25 10:27:00 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:27:00 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:27:00 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Jul 25 10:27:00 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:27:00 user nova-compute[71312]:       <serial>668f4c99-6670-445e-827d-120884481ae4</serial>
Jul 25 10:27:00 user nova-compute[71312]:     </disk>
Jul 25 10:27:00 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:27:00 user nova-compute[71312]:       <mac address="fa:16:3e:99:97:0c"/>
Jul 25 10:27:00 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:27:00 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:27:00 user nova-compute[71312]:       <target dev="tap0aab3747-d4"/>
Jul 25 10:27:00 user nova-compute[71312]:     </interface>
Jul 25 10:27:00 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:27:00 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/abdc34b5-ca82-4d14-8413-e254897676fd/console.log" append="off"/>
Jul 25 10:27:00 user nova-compute[71312]:     </serial>
Jul 25 10:27:00 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:27:00 user nova-compute[71312]:     <video>
Jul 25 10:27:00 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:27:00 user nova-compute[71312]:     </video>
Jul 25 10:27:00 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:27:00 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:27:00 user nova-compute[71312]:     </rng>
Jul 25 10:27:00 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:27:00 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:27:00 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:27:00 user nova-compute[71312]:     </memballoon>
Jul 25 10:27:00 user nova-compute[71312]:   </devices>
Jul 25 10:27:00 user nova-compute[71312]: </domain>
Jul 25 10:27:00 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:26:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1142318536',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1142318536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1142318536',id=46,image_ref='1246d48d-a0e0-4ebb-9cc5-51b86c27ef9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZN4iQ3YQZhR/MeNRJNqHF5LW4qaD8ZHCD/KGKnzXrMtV+Pd4EsK+hxZF9+n5ULs3sGsyGtUdwgs06RVm1xpOUHV/0hSX5/81ssmGdzmWAhP46mq+aHbGnxehJXLauwCw==',key_name='tempest-keypair-1194129302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-hht84cps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-614700428',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:26:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=abdc34b5-ca82-4d14-8413-e254897676fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "address": "fa:16:3e:99:97:0c", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aab3747-d4", "ovs_interfaceid": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "address": "fa:16:3e:99:97:0c", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aab3747-d4", "ovs_interfaceid": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:97:0c,bridge_name='br-int',has_traffic_filtering=True,id=0aab3747-d4f0-4905-8649-ba13ab4d81b8,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aab3747-d4') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG os_vif [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:97:0c,bridge_name='br-int',has_traffic_filtering=True,id=0aab3747-d4f0-4905-8649-ba13ab4d81b8,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aab3747-d4') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0aab3747-d4, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0aab3747-d4, col_values=(('external_ids', {'iface-id': '0aab3747-d4f0-4905-8649-ba13ab4d81b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:97:0c', 'vm-uuid': 'abdc34b5-ca82-4d14-8413-e254897676fd'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:00 user nova-compute[71312]: INFO os_vif [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:97:0c,bridge_name='br-int',has_traffic_filtering=True,id=0aab3747-d4f0-4905-8649-ba13ab4d81b8,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aab3747-d4')
Jul 25 10:27:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:27:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] No VIF found with MAC fa:16:3e:99:97:0c, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:27:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-b91f1724-d1d5-412f-8704-5d1ed77cd695 req-470c533c-e134-40aa-9b82-a39854b9b252 service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Received event network-vif-plugged-0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:27:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b91f1724-d1d5-412f-8704-5d1ed77cd695 req-470c533c-e134-40aa-9b82-a39854b9b252 service nova] Acquiring lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b91f1724-d1d5-412f-8704-5d1ed77cd695 req-470c533c-e134-40aa-9b82-a39854b9b252 service nova] Lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b91f1724-d1d5-412f-8704-5d1ed77cd695 req-470c533c-e134-40aa-9b82-a39854b9b252 service nova] Lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-b91f1724-d1d5-412f-8704-5d1ed77cd695 req-470c533c-e134-40aa-9b82-a39854b9b252 service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] No waiting events found dispatching network-vif-plugged-0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:27:02 user nova-compute[71312]: WARNING nova.compute.manager [req-b91f1724-d1d5-412f-8704-5d1ed77cd695 req-470c533c-e134-40aa-9b82-a39854b9b252 service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Received unexpected event network-vif-plugged-0aab3747-d4f0-4905-8649-ba13ab4d81b8 for instance with vm_state building and task_state spawning.
Jul 25 10:27:04 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280824.254462, abdc34b5-ca82-4d14-8413-e254897676fd => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:27:04 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] VM Resumed (Lifecycle Event)
Jul 25 10:27:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:27:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:27:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Instance spawned successfully.
Jul 25 10:27:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:27:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:27:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:27:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:27:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:27:04 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:27:04 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280824.254648, abdc34b5-ca82-4d14-8413-e254897676fd => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:27:04 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] VM Started (Lifecycle Event)
Jul 25 10:27:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:27:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:27:04 user nova-compute[71312]: INFO nova.compute.manager [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Took 4.87 seconds to spawn the instance on the hypervisor.
Jul 25 10:27:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:27:04 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:27:04 user nova-compute[71312]: INFO nova.compute.manager [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Took 18.42 seconds to build instance.
Jul 25 10:27:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c3c4b80-afd8-419c-bdbe-71b3506ac663 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "abdc34b5-ca82-4d14-8413-e254897676fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.545s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-baba54cb-1165-46aa-b5f3-66330c843d48 req-84120642-3b87-4f91-b6ef-56c70cd9ff2e service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Received event network-vif-plugged-0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:27:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-baba54cb-1165-46aa-b5f3-66330c843d48 req-84120642-3b87-4f91-b6ef-56c70cd9ff2e service nova] Acquiring lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-baba54cb-1165-46aa-b5f3-66330c843d48 req-84120642-3b87-4f91-b6ef-56c70cd9ff2e service nova] Lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-baba54cb-1165-46aa-b5f3-66330c843d48 req-84120642-3b87-4f91-b6ef-56c70cd9ff2e service nova] Lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-baba54cb-1165-46aa-b5f3-66330c843d48 req-84120642-3b87-4f91-b6ef-56c70cd9ff2e service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] No waiting events found dispatching network-vif-plugged-0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:27:04 user nova-compute[71312]: WARNING nova.compute.manager [req-baba54cb-1165-46aa-b5f3-66330c843d48 req-84120642-3b87-4f91-b6ef-56c70cd9ff2e service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Received unexpected event network-vif-plugged-0aab3747-d4f0-4905-8649-ba13ab4d81b8 for instance with vm_state active and task_state None.
Jul 25 10:27:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_power_states {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid b92c3f88-c9c0-4961-8b53-511c215bed39 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid f7858973-7146-4229-9f41-00ebcc7618b4 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 411b2cee-bb2d-4b65-921c-3248c1edc454 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 19ed556d-1ecc-4252-bd17-2c8bf555f8be {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid abdc34b5-ca82-4d14-8413-e254897676fd {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "b92c3f88-c9c0-4961-8b53-511c215bed39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "f7858973-7146-4229-9f41-00ebcc7618b4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "f7858973-7146-4229-9f41-00ebcc7618b4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "abdc34b5-ca82-4d14-8413-e254897676fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "abdc34b5-ca82-4d14-8413-e254897676fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "f7858973-7146-4229-9f41-00ebcc7618b4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "abdc34b5-ca82-4d14-8413-e254897676fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-8d43ade6-98be-4b62-8e26-e64e690e428e req-ed17c6e9-482a-4433-8173-96cb93b01388 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Received event network-changed-b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:27:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-8d43ade6-98be-4b62-8e26-e64e690e428e req-ed17c6e9-482a-4433-8173-96cb93b01388 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Refreshing instance network info cache due to event network-changed-b53e70b3-cc1f-457c-a38b-a984e733116e. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:27:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d43ade6-98be-4b62-8e26-e64e690e428e req-ed17c6e9-482a-4433-8173-96cb93b01388 service nova] Acquiring lock "refresh_cache-9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:27:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d43ade6-98be-4b62-8e26-e64e690e428e req-ed17c6e9-482a-4433-8173-96cb93b01388 service nova] Acquired lock "refresh_cache-9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:27:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-8d43ade6-98be-4b62-8e26-e64e690e428e req-ed17c6e9-482a-4433-8173-96cb93b01388 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Refreshing network info cache for port b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:27:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:22 user nova-compute[71312]: INFO nova.compute.manager [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Terminating instance
Jul 25 10:27:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:27:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG nova.network.neutron [req-8d43ade6-98be-4b62-8e26-e64e690e428e req-ed17c6e9-482a-4433-8173-96cb93b01388 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Updated VIF entry in instance network info cache for port b53e70b3-cc1f-457c-a38b-a984e733116e. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG nova.network.neutron [req-8d43ade6-98be-4b62-8e26-e64e690e428e req-ed17c6e9-482a-4433-8173-96cb93b01388 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Updating instance_info_cache with network_info: [{"id": "b53e70b3-cc1f-457c-a38b-a984e733116e", "address": "fa:16:3e:e0:f9:ce", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53e70b3-cc", "ovs_interfaceid": "b53e70b3-cc1f-457c-a38b-a984e733116e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d43ade6-98be-4b62-8e26-e64e690e428e req-ed17c6e9-482a-4433-8173-96cb93b01388 service nova] Releasing lock "refresh_cache-9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:27:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Instance destroyed successfully.
Jul 25 10:27:23 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lazy-loading 'resources' on Instance uuid 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-264739796',display_name='tempest-TestStampPattern-server-264739796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-264739796',id=42,image_ref='1dc25d41-41e8-4a66-8610-299ef9f438e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO1P3w5txB81eBV0yGtov3Oc4MCOl8jqxiKKGPa9B1SJkwnNnhcpWHBgFyyPz0VqYDAtprnCkjl1yxKxNR+/1Pg+zuU7SSaxI20iqUoduPzUQp894ipIxOppnDgCxC0Mw==',key_name='tempest-TestStampPattern-764832787',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bfc3cefb0ef4063b439dcbd676372de',ramdisk_id='',reservation_id='r-u4i6ekdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f7858973-7146-4229-9f41-00ebcc7618b4',image_min_disk='1',image_min_ram='0',image_owner_id='1bfc3cefb0ef4063b439dcbd676372de',image_owner_project_name='tempest-TestStampPattern-1852512142',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1852512142-project-member',image_user_id='0cca4cdd12f543a2a5864f8a36f56cb4',owner_project_name='tempest-TestStampPattern-1852512142',owner_user_name='tempest-TestStampPattern-1852512142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:24:37Z,user_data=None,user_id='0cca4cdd12f543a2a5864f8a36f56cb4',uuid=9c2097e9-6079-4ccc-9ca5-5fcfd035d61b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b53e70b3-cc1f-457c-a38b-a984e733116e", "address": "fa:16:3e:e0:f9:ce", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53e70b3-cc", "ovs_interfaceid": "b53e70b3-cc1f-457c-a38b-a984e733116e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Converting VIF {"id": "b53e70b3-cc1f-457c-a38b-a984e733116e", "address": "fa:16:3e:e0:f9:ce", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53e70b3-cc", "ovs_interfaceid": "b53e70b3-cc1f-457c-a38b-a984e733116e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:f9:ce,bridge_name='br-int',has_traffic_filtering=True,id=b53e70b3-cc1f-457c-a38b-a984e733116e,network=Network(500d3ecb-db5e-4d97-abcc-16264ba81220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53e70b3-cc') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG os_vif [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:f9:ce,bridge_name='br-int',has_traffic_filtering=True,id=b53e70b3-cc1f-457c-a38b-a984e733116e,network=Network(500d3ecb-db5e-4d97-abcc-16264ba81220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53e70b3-cc') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb53e70b3-cc, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:23 user nova-compute[71312]: INFO os_vif [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:f9:ce,bridge_name='br-int',has_traffic_filtering=True,id=b53e70b3-cc1f-457c-a38b-a984e733116e,network=Network(500d3ecb-db5e-4d97-abcc-16264ba81220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53e70b3-cc')
Jul 25 10:27:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Deleting instance files /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b_del
Jul 25 10:27:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Deletion of /opt/stack/data/nova/instances/9c2097e9-6079-4ccc-9ca5-5fcfd035d61b_del complete
Jul 25 10:27:23 user nova-compute[71312]: INFO nova.compute.manager [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 25 10:27:23 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:27:23 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:27:24 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Took 0.42 seconds to deallocate network for instance.
Jul 25 10:27:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-661e71ea-584e-48b9-9732-d2524099ff29 req-9c4dd76c-9515-4e5a-bdfc-766824f781a7 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Received event network-vif-deleted-b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:27:24 user nova-compute[71312]: INFO nova.compute.manager [req-661e71ea-584e-48b9-9732-d2524099ff29 req-9c4dd76c-9515-4e5a-bdfc-766824f781a7 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Neutron deleted interface b53e70b3-cc1f-457c-a38b-a984e733116e; detaching it from the instance and deleting it from the info cache
Jul 25 10:27:24 user nova-compute[71312]: DEBUG nova.network.neutron [req-661e71ea-584e-48b9-9732-d2524099ff29 req-9c4dd76c-9515-4e5a-bdfc-766824f781a7 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-661e71ea-584e-48b9-9732-d2524099ff29 req-9c4dd76c-9515-4e5a-bdfc-766824f781a7 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Detach interface failed, port_id=b53e70b3-cc1f-457c-a38b-a984e733116e, reason: Instance 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:24 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Deleted allocations for instance 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b
Jul 25 10:27:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f793929-df20-4b9a-87be-907dddd29acf tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.772s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-5553c6ee-631f-4126-b1cf-52760e94db91 req-e3029fa2-596b-4b58-82dd-465b92a71166 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Received event network-vif-unplugged-b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5553c6ee-631f-4126-b1cf-52760e94db91 req-e3029fa2-596b-4b58-82dd-465b92a71166 service nova] Acquiring lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5553c6ee-631f-4126-b1cf-52760e94db91 req-e3029fa2-596b-4b58-82dd-465b92a71166 service nova] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5553c6ee-631f-4126-b1cf-52760e94db91 req-e3029fa2-596b-4b58-82dd-465b92a71166 service nova] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-5553c6ee-631f-4126-b1cf-52760e94db91 req-e3029fa2-596b-4b58-82dd-465b92a71166 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] No waiting events found dispatching network-vif-unplugged-b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:27:24 user nova-compute[71312]: WARNING nova.compute.manager [req-5553c6ee-631f-4126-b1cf-52760e94db91 req-e3029fa2-596b-4b58-82dd-465b92a71166 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Received unexpected event network-vif-unplugged-b53e70b3-cc1f-457c-a38b-a984e733116e for instance with vm_state deleted and task_state None.
Jul 25 10:27:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-5553c6ee-631f-4126-b1cf-52760e94db91 req-e3029fa2-596b-4b58-82dd-465b92a71166 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Received event network-vif-plugged-b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5553c6ee-631f-4126-b1cf-52760e94db91 req-e3029fa2-596b-4b58-82dd-465b92a71166 service nova] Acquiring lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5553c6ee-631f-4126-b1cf-52760e94db91 req-e3029fa2-596b-4b58-82dd-465b92a71166 service nova] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5553c6ee-631f-4126-b1cf-52760e94db91 req-e3029fa2-596b-4b58-82dd-465b92a71166 service nova] Lock "9c2097e9-6079-4ccc-9ca5-5fcfd035d61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-5553c6ee-631f-4126-b1cf-52760e94db91 req-e3029fa2-596b-4b58-82dd-465b92a71166 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] No waiting events found dispatching network-vif-plugged-b53e70b3-cc1f-457c-a38b-a984e733116e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:27:24 user nova-compute[71312]: WARNING nova.compute.manager [req-5553c6ee-631f-4126-b1cf-52760e94db91 req-e3029fa2-596b-4b58-82dd-465b92a71166 service nova] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Received unexpected event network-vif-plugged-b53e70b3-cc1f-457c-a38b-a984e733116e for instance with vm_state deleted and task_state None.
Jul 25 10:27:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-2f57712e-15c4-4be8-a683-71cad4a40bb3 req-07f2191c-87db-4670-8c38-5aa8fbf736f0 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-changed-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:27:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-2f57712e-15c4-4be8-a683-71cad4a40bb3 req-07f2191c-87db-4670-8c38-5aa8fbf736f0 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Refreshing instance network info cache due to event network-changed-e106eac1-ef6b-4663-b6f2-db444d8aefb6. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:27:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2f57712e-15c4-4be8-a683-71cad4a40bb3 req-07f2191c-87db-4670-8c38-5aa8fbf736f0 service nova] Acquiring lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:27:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2f57712e-15c4-4be8-a683-71cad4a40bb3 req-07f2191c-87db-4670-8c38-5aa8fbf736f0 service nova] Acquired lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:27:26 user nova-compute[71312]: DEBUG nova.network.neutron [req-2f57712e-15c4-4be8-a683-71cad4a40bb3 req-07f2191c-87db-4670-8c38-5aa8fbf736f0 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Refreshing network info cache for port e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:27:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-2f57712e-15c4-4be8-a683-71cad4a40bb3 req-07f2191c-87db-4670-8c38-5aa8fbf736f0 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updated VIF entry in instance network info cache for port e106eac1-ef6b-4663-b6f2-db444d8aefb6. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:27:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-2f57712e-15c4-4be8-a683-71cad4a40bb3 req-07f2191c-87db-4670-8c38-5aa8fbf736f0 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updating instance_info_cache with network_info: [{"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:27:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2f57712e-15c4-4be8-a683-71cad4a40bb3 req-07f2191c-87db-4670-8c38-5aa8fbf736f0 service nova] Releasing lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:27:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:28 user nova-compute[71312]: INFO nova.compute.manager [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Shelve offloading
Jul 25 10:27:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-056c4a81-eb80-4634-b553-224393afd02f req-3cea14e7-619d-43fe-be8d-98b8ac747879 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-unplugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:27:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-056c4a81-eb80-4634-b553-224393afd02f req-3cea14e7-619d-43fe-be8d-98b8ac747879 service nova] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-056c4a81-eb80-4634-b553-224393afd02f req-3cea14e7-619d-43fe-be8d-98b8ac747879 service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-056c4a81-eb80-4634-b553-224393afd02f req-3cea14e7-619d-43fe-be8d-98b8ac747879 service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-056c4a81-eb80-4634-b553-224393afd02f req-3cea14e7-619d-43fe-be8d-98b8ac747879 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] No waiting events found dispatching network-vif-unplugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:27:28 user nova-compute[71312]: WARNING nova.compute.manager [req-056c4a81-eb80-4634-b553-224393afd02f req-3cea14e7-619d-43fe-be8d-98b8ac747879 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received unexpected event network-vif-unplugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 for instance with vm_state active and task_state shelving.
Jul 25 10:27:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Instance destroyed successfully.
Jul 25 10:27:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:27:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:27:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquired lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:27:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:27:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updating instance_info_cache with network_info: [{"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:27:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Releasing lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:27:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Instance destroyed successfully.
Jul 25 10:27:30 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lazy-loading 'resources' on Instance uuid eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-640868858',display_name='tempest-TestShelveInstance-server-640868858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-640868858',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqxVb5e9N0lVwsLreb6pD+UbhMUEIvVlIpx68ZdnAVOirPmGdfmeDGUtlrFHOvJWy7C0wxrN/ryaek+RqtJYd5hEh+qSczaUBpzQDtxPu/koDkoaIc0jlRLdeFsDW2MYg==',key_name='tempest-TestShelveInstance-1889794562',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:25:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12bafba94e094b77a9c0a19358ab4af3',ramdisk_id='',reservation_id='r-n3bye7vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-354481259',owner_user_name='tempest-TestShelveInstance-354481259-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:25:47Z,user_data=None,user_id='79d1e9b058e541babcbd999c4772e841',uuid=eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Converting VIF {"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3b:21,bridge_name='br-int',has_traffic_filtering=True,id=e106eac1-ef6b-4663-b6f2-db444d8aefb6,network=Network(026a8069-3a0d-4c92-9c23-c6a27f09272e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape106eac1-ef') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_vif [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3b:21,bridge_name='br-int',has_traffic_filtering=True,id=e106eac1-ef6b-4663-b6f2-db444d8aefb6,network=Network(026a8069-3a0d-4c92-9c23-c6a27f09272e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape106eac1-ef') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape106eac1-ef, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:27:30 user nova-compute[71312]: INFO os_vif [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3b:21,bridge_name='br-int',has_traffic_filtering=True,id=e106eac1-ef6b-4663-b6f2-db444d8aefb6,network=Network(026a8069-3a0d-4c92-9c23-c6a27f09272e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape106eac1-ef')
Jul 25 10:27:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpqXZdIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:27:30 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bcf2d6-731d-4353-af03-17f2975cd134]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:27:30 user nova-compute[71312]: No targets found.
Jul 25 10:27:30 user nova-compute[71312]: iSNS:
Jul 25 10:27:30 user nova-compute[71312]: No targets found.
Jul 25 10:27:30 user nova-compute[71312]: STATIC:
Jul 25 10:27:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3
Jul 25 10:27:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:27:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:27:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4
Jul 25 10:27:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:27:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:27:30 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939
Jul 25 10:27:30 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:27:30 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:27:30 user nova-compute[71312]: FIRMWARE:
Jul 25 10:27:30 user nova-compute[71312]: No targets found.
Jul 25 10:27:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:27:30 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:27:30 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ddcaf9-7293-43da-967c-acaba1df036c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-0d1613ce-6d37-47f8-8cad-f76f2ded4d44 req-51ca9dc1-aaaf-43b2-8ecf-8ad11a1781d1 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-changed-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-0d1613ce-6d37-47f8-8cad-f76f2ded4d44 req-51ca9dc1-aaaf-43b2-8ecf-8ad11a1781d1 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Refreshing instance network info cache due to event network-changed-e106eac1-ef6b-4663-b6f2-db444d8aefb6. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0d1613ce-6d37-47f8-8cad-f76f2ded4d44 req-51ca9dc1-aaaf-43b2-8ecf-8ad11a1781d1 service nova] Acquiring lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0d1613ce-6d37-47f8-8cad-f76f2ded4d44 req-51ca9dc1-aaaf-43b2-8ecf-8ad11a1781d1 service nova] Acquired lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-0d1613ce-6d37-47f8-8cad-f76f2ded4d44 req-51ca9dc1-aaaf-43b2-8ecf-8ad11a1781d1 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Refreshing network info cache for port e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[80224d31-5064-41c0-9de2-901bf5134834]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:27:30 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:27:30 user nova-compute[71312]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)
Jul 25 10:27:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:27:30 user nova-compute[71312]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:27:30 user nova-compute[71312]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)
Jul 25 10:27:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c0134940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5becf3f6-705f-48ee-9b17-5b657b4f490d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[384cd256-afec-4e0f-a626-f7d7160987f5]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52b6c13-c009-4eef-9fe6-a8730010f0f6]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6cce75-d1c6-451d-9a14-12572b0c9133]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a34efb5-9935-4c24-8493-f9c6302ede49]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-f1e34f49-5cfc-4826-98d7-bc171f9dc030 req-eceb423b-210a-4876-9a6a-1d60a0790a43 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f1e34f49-5cfc-4826-98d7-bc171f9dc030 req-eceb423b-210a-4876-9a6a-1d60a0790a43 service nova] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f1e34f49-5cfc-4826-98d7-bc171f9dc030 req-eceb423b-210a-4876-9a6a-1d60a0790a43 service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f1e34f49-5cfc-4826-98d7-bc171f9dc030 req-eceb423b-210a-4876-9a6a-1d60a0790a43 service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-f1e34f49-5cfc-4826-98d7-bc171f9dc030 req-eceb423b-210a-4876-9a6a-1d60a0790a43 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] No waiting events found dispatching network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:27:30 user nova-compute[71312]: WARNING nova.compute.manager [req-f1e34f49-5cfc-4826-98d7-bc171f9dc030 req-eceb423b-210a-4876-9a6a-1d60a0790a43 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received unexpected event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 for instance with vm_state active and task_state shelving.
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d642b38-6776-4fcf-bdf0-95addac9438f]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260]
Jul 25 10:27:30 user nova-compute[71312]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260] successful.
Jul 25 10:27:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd58423-d267-4232-a197-7330b25e4423]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] <== disconnect_volume: return (337ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:27:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Deleting instance files /opt/stack/data/nova/instances/eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338_del
Jul 25 10:27:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Deletion of /opt/stack/data/nova/instances/eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338_del complete
Jul 25 10:27:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-0d1613ce-6d37-47f8-8cad-f76f2ded4d44 req-51ca9dc1-aaaf-43b2-8ecf-8ad11a1781d1 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updated VIF entry in instance network info cache for port e106eac1-ef6b-4663-b6f2-db444d8aefb6. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-0d1613ce-6d37-47f8-8cad-f76f2ded4d44 req-51ca9dc1-aaaf-43b2-8ecf-8ad11a1781d1 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updating instance_info_cache with network_info: [{"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": null, "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape106eac1-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:27:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0d1613ce-6d37-47f8-8cad-f76f2ded4d44 req-51ca9dc1-aaaf-43b2-8ecf-8ad11a1781d1 service nova] Releasing lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:27:31 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Deleted allocations for instance eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338
Jul 25 10:27:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:31 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lazy-loading 'numa_topology' on Instance uuid eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:27:31 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:27:31 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:27:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5bbb101-e2f4-4b8c-9a8b-658b42d22db2 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.742s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:27:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:27:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 10:27:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:27:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:27:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:27:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lazy-loading 'info_cache' on Instance uuid 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:27:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Updating instance_info_cache with network_info: [{"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:27:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:27:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:27:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:27:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:27:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:27:38 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280843.614867, 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:27:38 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] VM Stopped (Lifecycle Event)
Jul 25 10:27:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-31a1a479-c317-421a-bdb7-39ceb11d7336 None None] [instance: 9c2097e9-6079-4ccc-9ca5-5fcfd035d61b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:27:38 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:27:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:41 user nova-compute[71312]: INFO nova.compute.manager [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Terminating instance
Jul 25 10:27:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-8652b818-ff8b-4fc1-83c2-619559911574 req-ed86b84d-d6b5-4bed-833a-437d2dc557ed service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-vif-unplugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8652b818-ff8b-4fc1-83c2-619559911574 req-ed86b84d-d6b5-4bed-833a-437d2dc557ed service nova] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8652b818-ff8b-4fc1-83c2-619559911574 req-ed86b84d-d6b5-4bed-833a-437d2dc557ed service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8652b818-ff8b-4fc1-83c2-619559911574 req-ed86b84d-d6b5-4bed-833a-437d2dc557ed service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-8652b818-ff8b-4fc1-83c2-619559911574 req-ed86b84d-d6b5-4bed-833a-437d2dc557ed service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] No waiting events found dispatching network-vif-unplugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-8652b818-ff8b-4fc1-83c2-619559911574 req-ed86b84d-d6b5-4bed-833a-437d2dc557ed service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-vif-unplugged-21c48988-5022-49f7-baa0-a10dfdc879bd for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:27:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:42 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Instance destroyed successfully.
Jul 25 10:27:42 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'resources' on Instance uuid 411b2cee-bb2d-4b65-921c-3248c1edc454 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1650432608',display_name='tempest-TestMinimumBasicScenario-server-1650432608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1650432608',id=41,image_ref='d9c394da-76f3-4440-a72f-e13318a0982c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGg3j14zcpk1Y5NEPPiDHV/l/W/r76eTIQ6WTapG9XZ5IbgVeFP1qKyfBeaNpLBhqdsADos6R8ho5+EZ8JxYEhwl8T8FnA+Tk0HcWqExlEpdX5Ph68BTxiht5yVBbwwmA==',key_name='tempest-TestMinimumBasicScenario-271951688',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:22:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d929f478538e4a13808c730ae670e6ac',ramdisk_id='',reservation_id='r-pxzhwxzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d9c394da-76f3-4440-a72f-e13318a0982c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1169366909',owner_user_name='tempest-TestMinimumBasicScenario-1169366909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:25:02Z,user_data=None,user_id='12610a082fb54137a6c6752c800bd393',uuid=411b2cee-bb2d-4b65-921c-3248c1edc454,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converting VIF {"id": "21c48988-5022-49f7-baa0-a10dfdc879bd", "address": "fa:16:3e:61:42:1f", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c48988-50", "ovs_interfaceid": "21c48988-5022-49f7-baa0-a10dfdc879bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:42:1f,bridge_name='br-int',has_traffic_filtering=True,id=21c48988-5022-49f7-baa0-a10dfdc879bd,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c48988-50') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG os_vif [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:42:1f,bridge_name='br-int',has_traffic_filtering=True,id=21c48988-5022-49f7-baa0-a10dfdc879bd,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c48988-50') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21c48988-50, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:27:42 user nova-compute[71312]: INFO os_vif [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:42:1f,bridge_name='br-int',has_traffic_filtering=True,id=21c48988-5022-49f7-baa0-a10dfdc879bd,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c48988-50')
Jul 25 10:27:42 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Deleting instance files /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454_del
Jul 25 10:27:42 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Deletion of /opt/stack/data/nova/instances/411b2cee-bb2d-4b65-921c-3248c1edc454_del complete
Jul 25 10:27:42 user nova-compute[71312]: INFO nova.compute.manager [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 25 10:27:42 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:27:42 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Took 0.44 seconds to deallocate network for instance.
Jul 25 10:27:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:27:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:42 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Deleted allocations for instance 411b2cee-bb2d-4b65-921c-3248c1edc454
Jul 25 10:27:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c29079a6-1f2e-43df-9e41-49ff25acc2f7 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.802s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-97f5704b-5a82-4d47-860a-ec7e4da11988 req-058e40bb-50cf-4d83-8265-cebf40be5788 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:27:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97f5704b-5a82-4d47-860a-ec7e4da11988 req-058e40bb-50cf-4d83-8265-cebf40be5788 service nova] Acquiring lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97f5704b-5a82-4d47-860a-ec7e4da11988 req-058e40bb-50cf-4d83-8265-cebf40be5788 service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97f5704b-5a82-4d47-860a-ec7e4da11988 req-058e40bb-50cf-4d83-8265-cebf40be5788 service nova] Lock "411b2cee-bb2d-4b65-921c-3248c1edc454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-97f5704b-5a82-4d47-860a-ec7e4da11988 req-058e40bb-50cf-4d83-8265-cebf40be5788 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] No waiting events found dispatching network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:27:43 user nova-compute[71312]: WARNING nova.compute.manager [req-97f5704b-5a82-4d47-860a-ec7e4da11988 req-058e40bb-50cf-4d83-8265-cebf40be5788 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received unexpected event network-vif-plugged-21c48988-5022-49f7-baa0-a10dfdc879bd for instance with vm_state deleted and task_state None.
Jul 25 10:27:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-97f5704b-5a82-4d47-860a-ec7e4da11988 req-058e40bb-50cf-4d83-8265-cebf40be5788 service nova] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Received event network-vif-deleted-21c48988-5022-49f7-baa0-a10dfdc879bd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:27:43 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280848.9353569, eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:27:43 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] VM Stopped (Lifecycle Event)
Jul 25 10:27:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-70a4fc6e-b04f-4471-81e5-ad14642ebfa1 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:27:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:27:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:27:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:27:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:27:46 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:27:46 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:27:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=7974MB free_disk=25.00342559814453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:27:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:27:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:27:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:27:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:27:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance f7858973-7146-4229-9f41-00ebcc7618b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:27:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 19ed556d-1ecc-4252-bd17-2c8bf555f8be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:27:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8838dac5-9f12-4e01-9367-ad184cbc00b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:27:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance abdc34b5-ca82-4d14-8413-e254897676fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:27:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:27:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:27:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:47 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:27:47 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:27:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:27:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:27:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:27:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:27:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:27:57 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280862.0579052, 411b2cee-bb2d-4b65-921c-3248c1edc454 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:27:57 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] VM Stopped (Lifecycle Event)
Jul 25 10:27:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ae5c71c4-2ac4-4684-89a2-09c8bb6d4fd3 None None] [instance: 411b2cee-bb2d-4b65-921c-3248c1edc454] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:27:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:28:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:28:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:28:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:28:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:28:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:28:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-86cbe979-6c00-475f-b8b9-98f922fa0c0b req-84a3f466-8dca-474d-8a55-c2a41b617707 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Received event network-changed-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-86cbe979-6c00-475f-b8b9-98f922fa0c0b req-84a3f466-8dca-474d-8a55-c2a41b617707 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Refreshing instance network info cache due to event network-changed-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:28:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-86cbe979-6c00-475f-b8b9-98f922fa0c0b req-84a3f466-8dca-474d-8a55-c2a41b617707 service nova] Acquiring lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:28:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-86cbe979-6c00-475f-b8b9-98f922fa0c0b req-84a3f466-8dca-474d-8a55-c2a41b617707 service nova] Acquired lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:28:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-86cbe979-6c00-475f-b8b9-98f922fa0c0b req-84a3f466-8dca-474d-8a55-c2a41b617707 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Refreshing network info cache for port 1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "f7858973-7146-4229-9f41-00ebcc7618b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "f7858973-7146-4229-9f41-00ebcc7618b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:23 user nova-compute[71312]: INFO nova.compute.manager [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Terminating instance
Jul 25 10:28:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG nova.network.neutron [req-86cbe979-6c00-475f-b8b9-98f922fa0c0b req-84a3f466-8dca-474d-8a55-c2a41b617707 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Updated VIF entry in instance network info cache for port 1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG nova.network.neutron [req-86cbe979-6c00-475f-b8b9-98f922fa0c0b req-84a3f466-8dca-474d-8a55-c2a41b617707 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Updating instance_info_cache with network_info: [{"id": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "address": "fa:16:3e:54:ae:25", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0efcfa-7e", "ovs_interfaceid": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-445ebb64-2734-4c61-8196-028442fb03b4 req-500eb78e-12d3-4aef-82af-0465a2236b22 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Received event network-vif-unplugged-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-445ebb64-2734-4c61-8196-028442fb03b4 req-500eb78e-12d3-4aef-82af-0465a2236b22 service nova] Acquiring lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-445ebb64-2734-4c61-8196-028442fb03b4 req-500eb78e-12d3-4aef-82af-0465a2236b22 service nova] Lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-445ebb64-2734-4c61-8196-028442fb03b4 req-500eb78e-12d3-4aef-82af-0465a2236b22 service nova] Lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-445ebb64-2734-4c61-8196-028442fb03b4 req-500eb78e-12d3-4aef-82af-0465a2236b22 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] No waiting events found dispatching network-vif-unplugged-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-445ebb64-2734-4c61-8196-028442fb03b4 req-500eb78e-12d3-4aef-82af-0465a2236b22 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Received event network-vif-unplugged-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-86cbe979-6c00-475f-b8b9-98f922fa0c0b req-84a3f466-8dca-474d-8a55-c2a41b617707 service nova] Releasing lock "refresh_cache-f7858973-7146-4229-9f41-00ebcc7618b4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:28:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Instance destroyed successfully.
Jul 25 10:28:23 user nova-compute[71312]: DEBUG nova.objects.instance [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lazy-loading 'resources' on Instance uuid f7858973-7146-4229-9f41-00ebcc7618b4 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1391802317',display_name='tempest-TestStampPattern-server-1391802317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1391802317',id=39,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO1P3w5txB81eBV0yGtov3Oc4MCOl8jqxiKKGPa9B1SJkwnNnhcpWHBgFyyPz0VqYDAtprnCkjl1yxKxNR+/1Pg+zuU7SSaxI20iqUoduPzUQp894ipIxOppnDgCxC0Mw==',key_name='tempest-TestStampPattern-764832787',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:21:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bfc3cefb0ef4063b439dcbd676372de',ramdisk_id='',reservation_id='r-93vmy134',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1852512142',owner_user_name='tempest-TestStampPattern-1852512142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:24:26Z,user_data=None,user_id='0cca4cdd12f543a2a5864f8a36f56cb4',uuid=f7858973-7146-4229-9f41-00ebcc7618b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "address": "fa:16:3e:54:ae:25", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0efcfa-7e", "ovs_interfaceid": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Converting VIF {"id": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "address": "fa:16:3e:54:ae:25", "network": {"id": "500d3ecb-db5e-4d97-abcc-16264ba81220", "bridge": "br-int", "label": "tempest-TestStampPattern-1875450886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfc3cefb0ef4063b439dcbd676372de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0efcfa-7e", "ovs_interfaceid": "1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:ae:25,bridge_name='br-int',has_traffic_filtering=True,id=1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d,network=Network(500d3ecb-db5e-4d97-abcc-16264ba81220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0efcfa-7e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG os_vif [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:ae:25,bridge_name='br-int',has_traffic_filtering=True,id=1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d,network=Network(500d3ecb-db5e-4d97-abcc-16264ba81220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0efcfa-7e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f0efcfa-7e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:23 user nova-compute[71312]: INFO os_vif [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:ae:25,bridge_name='br-int',has_traffic_filtering=True,id=1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d,network=Network(500d3ecb-db5e-4d97-abcc-16264ba81220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0efcfa-7e')
Jul 25 10:28:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Deleting instance files /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4_del
Jul 25 10:28:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Deletion of /opt/stack/data/nova/instances/f7858973-7146-4229-9f41-00ebcc7618b4_del complete
Jul 25 10:28:23 user nova-compute[71312]: INFO nova.compute.manager [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 25 10:28:23 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:28:23 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:28:24 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:28:24 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Took 0.47 seconds to deallocate network for instance.
Jul 25 10:28:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-67fb56f6-4c69-4acf-bf0c-b5ec6134d280 req-35c681d5-33e8-4fb7-8984-24f25c6964bb service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Received event network-vif-deleted-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:24 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:28:24 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:28:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:24 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Deleted allocations for instance f7858973-7146-4229-9f41-00ebcc7618b4
Jul 25 10:28:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-527ef6c2-712f-4124-814e-63fd64df01aa tempest-TestStampPattern-1852512142 tempest-TestStampPattern-1852512142-project-member] Lock "f7858973-7146-4229-9f41-00ebcc7618b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.714s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-24f7fd76-359b-45ff-8e77-fbca941f5a28 req-aa305647-9395-4765-9314-fda3793bc051 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Received event network-vif-plugged-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24f7fd76-359b-45ff-8e77-fbca941f5a28 req-aa305647-9395-4765-9314-fda3793bc051 service nova] Acquiring lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24f7fd76-359b-45ff-8e77-fbca941f5a28 req-aa305647-9395-4765-9314-fda3793bc051 service nova] Lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24f7fd76-359b-45ff-8e77-fbca941f5a28 req-aa305647-9395-4765-9314-fda3793bc051 service nova] Lock "f7858973-7146-4229-9f41-00ebcc7618b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-24f7fd76-359b-45ff-8e77-fbca941f5a28 req-aa305647-9395-4765-9314-fda3793bc051 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] No waiting events found dispatching network-vif-plugged-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:28:25 user nova-compute[71312]: WARNING nova.compute.manager [req-24f7fd76-359b-45ff-8e77-fbca941f5a28 req-aa305647-9395-4765-9314-fda3793bc051 service nova] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Received unexpected event network-vif-plugged-1f0efcfa-7efc-4ecc-befe-828cc7a2dc5d for instance with vm_state deleted and task_state None.
Jul 25 10:28:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-b11f6649-131b-4d68-a207-ea2690f2ba03 req-092ef6a1-e4d6-4f04-9155-55bcee32f073 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-changed-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-b11f6649-131b-4d68-a207-ea2690f2ba03 req-092ef6a1-e4d6-4f04-9155-55bcee32f073 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Refreshing instance network info cache due to event network-changed-e682c004-dec6-4b49-8eed-ae0ea3306002. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:28:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b11f6649-131b-4d68-a207-ea2690f2ba03 req-092ef6a1-e4d6-4f04-9155-55bcee32f073 service nova] Acquiring lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:28:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b11f6649-131b-4d68-a207-ea2690f2ba03 req-092ef6a1-e4d6-4f04-9155-55bcee32f073 service nova] Acquired lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:28:28 user nova-compute[71312]: DEBUG nova.network.neutron [req-b11f6649-131b-4d68-a207-ea2690f2ba03 req-092ef6a1-e4d6-4f04-9155-55bcee32f073 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Refreshing network info cache for port e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'flavor' on Instance uuid 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:29 user nova-compute[71312]: INFO nova.compute.manager [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Attaching volume 8c8965d2-e64b-4bd3-8aed-62e93b15768d to /dev/vdb
Jul 25 10:28:29 user nova-compute[71312]: DEBUG os_brick.utils [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b92053-f5d7-449d-a56a-ee4e9f10bf2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d04d386-09b9-4f99-abae-9fd0c5be4b9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-b11f6649-131b-4d68-a207-ea2690f2ba03 req-092ef6a1-e4d6-4f04-9155-55bcee32f073 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updated VIF entry in instance network info cache for port e682c004-dec6-4b49-8eed-ae0ea3306002. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-b11f6649-131b-4d68-a207-ea2690f2ba03 req-092ef6a1-e4d6-4f04-9155-55bcee32f073 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updating instance_info_cache with network_info: [{"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[937c0236-288d-4770-8934-2bc4d83757b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7cef04-301a-4098-9450-ee037f54d0cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b11f6649-131b-4d68-a207-ea2690f2ba03 req-092ef6a1-e4d6-4f04-9155-55bcee32f073 service nova] Releasing lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:28:29 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:28:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e378887-1768-4e1e-be49-aa7e67834dda]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG os_brick.utils [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:28:29 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updating existing volume attachment record: 1592c340-84c2-4078-99b7-fb6e105f877b {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:28:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:28:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:28:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:28:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:28:33 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:28:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Updating instance_info_cache with network_info: [{"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:28:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:28:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:28:35 user nova-compute[71312]: INFO nova.compute.claims [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Claim successful on node user
Jul 25 10:28:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:28:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:28:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG nova.policy [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12610a082fb54137a6c6752c800bd393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd929f478538e4a13808c730ae670e6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:28:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Creating image(s)
Jul 25 10:28:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "/opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "/opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "/opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3.part --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG nova.virt.images [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] d0c6a084-4209-4a0d-bef7-e24c799f1706 was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3.part /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYZoJglF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:28:36 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:28:36 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:28:36 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:28:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Successfully created port: 5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5264ae-c493-45f6-be32-3e92772e92a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:28:36 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2226fa0e-08c3-4fae-a3f9-bb73f3522a8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d] added
Jul 25 10:28:36 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.068s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3843f473-faa6-4afc-9560-fcb902255941]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05f5a52-eeec-4423-899d-89d0f75e725c]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYZoJglF {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYZoJglF" returned: 0 in 0.172s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc71616-e398-48e6-ae91-41c3d164e7d7]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYZoJglF'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1126ff-0287-45e5-aaa1-947b2a93197f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[79052797-a0e6-4685-8605-997aa78facd8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:28:36 user nova-compute[71312]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)
Jul 25 10:28:36 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:28:36 user nova-compute[71312]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)
Jul 25 10:28:36 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[975b164c-c90a-4f14-8fcc-7ed5700870fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d, portal: 172.16.0.220,3260]
Jul 25 10:28:36 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d, portal: 172.16.0.220,3260] successful.
Jul 25 10:28:36 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1585e2b-7771-46ae-9d4d-1a7d3fb84ad3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3.part /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3.converted" returned: 0 in 0.609s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23c827d-e61b-41c7-8b26-42fa8721bf8c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:28:37 user nova-compute[71312]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)
Jul 25 10:28:37 user nova-compute[71312]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:28:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:28:37 user nova-compute[71312]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)
Jul 25 10:28:37 user nova-compute[71312]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:28:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.597s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7bf1ff-1865-4d90-ae7c-bd927393cf6b]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYZoJglF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3.converted --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.398s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3 --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3 --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3,backing_fmt=raw /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3,backing_fmt=raw /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk 1073741824" returned: 0 in 0.185s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3 --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-9dcf8cbc-89a8-4f84-9c45-0a72d84a2849 req-098f41cb-8e2b-4d92-94df-1d8d9935542e service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Received event network-changed-0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-9dcf8cbc-89a8-4f84-9c45-0a72d84a2849 req-098f41cb-8e2b-4d92-94df-1d8d9935542e service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Refreshing instance network info cache due to event network-changed-0aab3747-d4f0-4905-8649-ba13ab4d81b8. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9dcf8cbc-89a8-4f84-9c45-0a72d84a2849 req-098f41cb-8e2b-4d92-94df-1d8d9935542e service nova] Acquiring lock "refresh_cache-abdc34b5-ca82-4d14-8413-e254897676fd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9dcf8cbc-89a8-4f84-9c45-0a72d84a2849 req-098f41cb-8e2b-4d92-94df-1d8d9935542e service nova] Acquired lock "refresh_cache-abdc34b5-ca82-4d14-8413-e254897676fd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-9dcf8cbc-89a8-4f84-9c45-0a72d84a2849 req-098f41cb-8e2b-4d92-94df-1d8d9935542e service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Refreshing network info cache for port 0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Cannot resize image /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'migration_context' on Instance uuid 945e356f-84fd-4b69-aa58-0b06f8dfe3cb {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Ensure instance console log exists: /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Successfully updated port: 5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquired lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:28:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-3102c40c-d163-4ef3-a98f-648058b35c20 req-43bc3875-62f5-46e8-a86a-7630a9e91694 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-changed-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-3102c40c-d163-4ef3-a98f-648058b35c20 req-43bc3875-62f5-46e8-a86a-7630a9e91694 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Refreshing instance network info cache due to event network-changed-5e5c7cae-cb17-4b6b-8775-39c043df4cb1. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3102c40c-d163-4ef3-a98f-648058b35c20 req-43bc3875-62f5-46e8-a86a-7630a9e91694 service nova] Acquiring lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.637s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] <== connect_volume: return (1640ms) {'type': 'block', 'scsi_wwn': '23433333034643264', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433333034643264', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.objects.instance [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'flavor' on Instance uuid 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:28:38 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:28:38 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Jul 25 10:28:38 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:28:38 user nova-compute[71312]:   <serial>8c8965d2-e64b-4bd3-8aed-62e93b15768d</serial>
Jul 25 10:28:38 user nova-compute[71312]: </disk>
Jul 25 10:28:38 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-9dcf8cbc-89a8-4f84-9c45-0a72d84a2849 req-098f41cb-8e2b-4d92-94df-1d8d9935542e service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Updated VIF entry in instance network info cache for port 0aab3747-d4f0-4905-8649-ba13ab4d81b8. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-9dcf8cbc-89a8-4f84-9c45-0a72d84a2849 req-098f41cb-8e2b-4d92-94df-1d8d9935542e service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Updating instance_info_cache with network_info: [{"id": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "address": "fa:16:3e:99:97:0c", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aab3747-d4", "ovs_interfaceid": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9dcf8cbc-89a8-4f84-9c45-0a72d84a2849 req-098f41cb-8e2b-4d92-94df-1d8d9935542e service nova] Releasing lock "refresh_cache-abdc34b5-ca82-4d14-8413-e254897676fd" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updating instance_info_cache with network_info: [{"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Releasing lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Instance network_info: |[{"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3102c40c-d163-4ef3-a98f-648058b35c20 req-43bc3875-62f5-46e8-a86a-7630a9e91694 service nova] Acquired lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-3102c40c-d163-4ef3-a98f-648058b35c20 req-43bc3875-62f5-46e8-a86a-7630a9e91694 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Refreshing network info cache for port 5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Start _get_guest_xml network_info=[{"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T10:28:32Z,direct_url=<?>,disk_format='qcow2',id=d0c6a084-4209-4a0d-bef7-e24c799f1706,min_disk=0,min_ram=0,name='tempest-scenario-img--382993428',owner='d929f478538e4a13808c730ae670e6ac',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T10:28:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'd0c6a084-4209-4a0d-bef7-e24c799f1706'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:28:38 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:28:38 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T10:28:32Z,direct_url=<?>,disk_format='qcow2',id=d0c6a084-4209-4a0d-bef7-e24c799f1706,min_disk=0,min_ram=0,name='tempest-scenario-img--382993428',owner='d929f478538e4a13808c730ae670e6ac',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T10:28:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:28:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1991218462',display_name='tempest-TestMinimumBasicScenario-server-1991218462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1991218462',id=47,image_ref='d0c6a084-4209-4a0d-bef7-e24c799f1706',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZR7SvHJc/LvHLCxjooonP2PBUXrZEoq00TtogFPSdn5e3sSHuBVRtRmO7cFWlw+3S1MBH80RNnvlKXg5WsdBvrGkeY9bD6j47bUl5W1wIrAmZDnRD5s6s/gjfbCz2YfA==',key_name='tempest-TestMinimumBasicScenario-2038096685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d929f478538e4a13808c730ae670e6ac',ramdisk_id='',reservation_id='r-40xc7efc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d0c6a084-4209-4a0d-bef7-e24c799f1706',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1169366909',owner_user_name='tempest-TestMinimumBasicScenario-1169366909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:28:36Z,user_data=None,user_id='12610a082fb54137a6c6752c800bd393',uuid=945e356f-84fd-4b69-aa58-0b06f8dfe3cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converting VIF {"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:35:1e,bridge_name='br-int',has_traffic_filtering=True,id=5e5c7cae-cb17-4b6b-8775-39c043df4cb1,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5c7cae-cb') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'pci_devices' on Instance uuid 945e356f-84fd-4b69-aa58-0b06f8dfe3cb {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:28:38 user nova-compute[71312]:   <uuid>945e356f-84fd-4b69-aa58-0b06f8dfe3cb</uuid>
Jul 25 10:28:38 user nova-compute[71312]:   <name>instance-0000002f</name>
Jul 25 10:28:38 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:28:38 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:28:38 user nova-compute[71312]:   <metadata>
Jul 25 10:28:38 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:28:38 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:28:38 user nova-compute[71312]:       <nova:name>tempest-TestMinimumBasicScenario-server-1991218462</nova:name>
Jul 25 10:28:38 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:28:38</nova:creationTime>
Jul 25 10:28:38 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:28:38 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:28:38 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:28:38 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:28:38 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:28:38 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:28:38 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:28:38 user nova-compute[71312]:       <nova:owner>
Jul 25 10:28:38 user nova-compute[71312]:         <nova:user uuid="12610a082fb54137a6c6752c800bd393">tempest-TestMinimumBasicScenario-1169366909-project-member</nova:user>
Jul 25 10:28:38 user nova-compute[71312]:         <nova:project uuid="d929f478538e4a13808c730ae670e6ac">tempest-TestMinimumBasicScenario-1169366909</nova:project>
Jul 25 10:28:38 user nova-compute[71312]:       </nova:owner>
Jul 25 10:28:38 user nova-compute[71312]:       <nova:root type="image" uuid="d0c6a084-4209-4a0d-bef7-e24c799f1706"/>
Jul 25 10:28:38 user nova-compute[71312]:       <nova:ports>
Jul 25 10:28:38 user nova-compute[71312]:         <nova:port uuid="5e5c7cae-cb17-4b6b-8775-39c043df4cb1">
Jul 25 10:28:38 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 10:28:38 user nova-compute[71312]:         </nova:port>
Jul 25 10:28:38 user nova-compute[71312]:       </nova:ports>
Jul 25 10:28:38 user nova-compute[71312]:     </nova:instance>
Jul 25 10:28:38 user nova-compute[71312]:   </metadata>
Jul 25 10:28:38 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:28:38 user nova-compute[71312]:     <system>
Jul 25 10:28:38 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:28:38 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:28:38 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:28:38 user nova-compute[71312]:       <entry name="serial">945e356f-84fd-4b69-aa58-0b06f8dfe3cb</entry>
Jul 25 10:28:38 user nova-compute[71312]:       <entry name="uuid">945e356f-84fd-4b69-aa58-0b06f8dfe3cb</entry>
Jul 25 10:28:38 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:28:38 user nova-compute[71312]:     </system>
Jul 25 10:28:38 user nova-compute[71312]:   </sysinfo>
Jul 25 10:28:38 user nova-compute[71312]:   <os>
Jul 25 10:28:38 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:28:38 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:28:38 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:28:38 user nova-compute[71312]:   </os>
Jul 25 10:28:38 user nova-compute[71312]:   <features>
Jul 25 10:28:38 user nova-compute[71312]:     <acpi/>
Jul 25 10:28:38 user nova-compute[71312]:     <apic/>
Jul 25 10:28:38 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:28:38 user nova-compute[71312]:   </features>
Jul 25 10:28:38 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:28:38 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:28:38 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:28:38 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:28:38 user nova-compute[71312]:   </clock>
Jul 25 10:28:38 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:28:38 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:28:38 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:28:38 user nova-compute[71312]:   </cpu>
Jul 25 10:28:38 user nova-compute[71312]:   <devices>
Jul 25 10:28:38 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:28:38 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:28:38 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk"/>
Jul 25 10:28:38 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:28:38 user nova-compute[71312]:     </disk>
Jul 25 10:28:38 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:28:38 user nova-compute[71312]:       <mac address="fa:16:3e:db:35:1e"/>
Jul 25 10:28:38 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:28:38 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:28:38 user nova-compute[71312]:       <target dev="tap5e5c7cae-cb"/>
Jul 25 10:28:38 user nova-compute[71312]:     </interface>
Jul 25 10:28:38 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:28:38 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/console.log" append="off"/>
Jul 25 10:28:38 user nova-compute[71312]:     </serial>
Jul 25 10:28:38 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:28:38 user nova-compute[71312]:     <video>
Jul 25 10:28:38 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:28:38 user nova-compute[71312]:     </video>
Jul 25 10:28:38 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:28:38 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:28:38 user nova-compute[71312]:     </rng>
Jul 25 10:28:38 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:28:38 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:28:38 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:28:38 user nova-compute[71312]:     </memballoon>
Jul 25 10:28:38 user nova-compute[71312]:   </devices>
Jul 25 10:28:38 user nova-compute[71312]: </domain>
Jul 25 10:28:38 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:28:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1991218462',display_name='tempest-TestMinimumBasicScenario-server-1991218462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1991218462',id=47,image_ref='d0c6a084-4209-4a0d-bef7-e24c799f1706',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZR7SvHJc/LvHLCxjooonP2PBUXrZEoq00TtogFPSdn5e3sSHuBVRtRmO7cFWlw+3S1MBH80RNnvlKXg5WsdBvrGkeY9bD6j47bUl5W1wIrAmZDnRD5s6s/gjfbCz2YfA==',key_name='tempest-TestMinimumBasicScenario-2038096685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d929f478538e4a13808c730ae670e6ac',ramdisk_id='',reservation_id='r-40xc7efc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d0c6a084-4209-4a0d-bef7-e24c799f1706',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1169366909',owner_user_name='tempest-TestMinimumBasicScenario-1169366909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:28:36Z,user_data=None,user_id='12610a082fb54137a6c6752c800bd393',uuid=945e356f-84fd-4b69-aa58-0b06f8dfe3cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converting VIF {"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:35:1e,bridge_name='br-int',has_traffic_filtering=True,id=5e5c7cae-cb17-4b6b-8775-39c043df4cb1,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5c7cae-cb') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG os_vif [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:35:1e,bridge_name='br-int',has_traffic_filtering=True,id=5e5c7cae-cb17-4b6b-8775-39c043df4cb1,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5c7cae-cb') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e5c7cae-cb, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e5c7cae-cb, col_values=(('external_ids', {'iface-id': '5e5c7cae-cb17-4b6b-8775-39c043df4cb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:35:1e', 'vm-uuid': '945e356f-84fd-4b69-aa58-0b06f8dfe3cb'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No VIF found with MAC fa:16:3e:b0:cc:58, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:38 user nova-compute[71312]: INFO os_vif [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:35:1e,bridge_name='br-int',has_traffic_filtering=True,id=5e5c7cae-cb17-4b6b-8775-39c043df4cb1,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5c7cae-cb')
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] No VIF found with MAC fa:16:3e:db:35:1e, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "abdc34b5-ca82-4d14-8413-e254897676fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "abdc34b5-ca82-4d14-8413-e254897676fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:38 user nova-compute[71312]: INFO nova.compute.manager [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Terminating instance
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280903.7736497, f7858973-7146-4229-9f41-00ebcc7618b4 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:28:38 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] VM Stopped (Lifecycle Event)
Jul 25 10:28:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a3c18b64-ccb2-45f0-8c6d-9c40bbe7f71e None None] [instance: f7858973-7146-4229-9f41-00ebcc7618b4] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-cd4560ec-5e8b-4643-9d6b-0dcf523a09f9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.479s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG nova.network.neutron [req-3102c40c-d163-4ef3-a98f-648058b35c20 req-43bc3875-62f5-46e8-a86a-7630a9e91694 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updated VIF entry in instance network info cache for port 5e5c7cae-cb17-4b6b-8775-39c043df4cb1. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG nova.network.neutron [req-3102c40c-d163-4ef3-a98f-648058b35c20 req-43bc3875-62f5-46e8-a86a-7630a9e91694 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updating instance_info_cache with network_info: [{"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG nova.compute.manager [req-89e5dd2f-bb67-4eca-8c0c-782edc9aadb6 req-665f1623-a272-443d-a56b-a9b095856fe8 service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Received event network-vif-unplugged-0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89e5dd2f-bb67-4eca-8c0c-782edc9aadb6 req-665f1623-a272-443d-a56b-a9b095856fe8 service nova] Acquiring lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89e5dd2f-bb67-4eca-8c0c-782edc9aadb6 req-665f1623-a272-443d-a56b-a9b095856fe8 service nova] Lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89e5dd2f-bb67-4eca-8c0c-782edc9aadb6 req-665f1623-a272-443d-a56b-a9b095856fe8 service nova] Lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG nova.compute.manager [req-89e5dd2f-bb67-4eca-8c0c-782edc9aadb6 req-665f1623-a272-443d-a56b-a9b095856fe8 service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] No waiting events found dispatching network-vif-unplugged-0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG nova.compute.manager [req-89e5dd2f-bb67-4eca-8c0c-782edc9aadb6 req-665f1623-a272-443d-a56b-a9b095856fe8 service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Received event network-vif-unplugged-0aab3747-d4f0-4905-8649-ba13ab4d81b8 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3102c40c-d163-4ef3-a98f-648058b35c20 req-43bc3875-62f5-46e8-a86a-7630a9e91694 service nova] Releasing lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:39 user nova-compute[71312]: INFO nova.compute.manager [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Rescuing
Jul 25 10:28:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquired lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updating instance_info_cache with network_info: [{"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Releasing lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:28:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-bafc05e5-caa6-4afc-84bb-aba2a301ee2a req-4e325765-6921-45f1-b1e6-4ac8e13e08fe service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-vif-unplugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bafc05e5-caa6-4afc-84bb-aba2a301ee2a req-4e325765-6921-45f1-b1e6-4ac8e13e08fe service nova] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bafc05e5-caa6-4afc-84bb-aba2a301ee2a req-4e325765-6921-45f1-b1e6-4ac8e13e08fe service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bafc05e5-caa6-4afc-84bb-aba2a301ee2a req-4e325765-6921-45f1-b1e6-4ac8e13e08fe service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-bafc05e5-caa6-4afc-84bb-aba2a301ee2a req-4e325765-6921-45f1-b1e6-4ac8e13e08fe service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] No waiting events found dispatching network-vif-unplugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:28:40 user nova-compute[71312]: WARNING nova.compute.manager [req-bafc05e5-caa6-4afc-84bb-aba2a301ee2a req-4e325765-6921-45f1-b1e6-4ac8e13e08fe service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received unexpected event network-vif-unplugged-e682c004-dec6-4b49-8eed-ae0ea3306002 for instance with vm_state active and task_state rescuing.
Jul 25 10:28:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Instance destroyed successfully.
Jul 25 10:28:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lazy-loading 'resources' on Instance uuid abdc34b5-ca82-4d14-8413-e254897676fd {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:26:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1142318536',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1142318536',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1142318536',id=46,image_ref='1246d48d-a0e0-4ebb-9cc5-51b86c27ef9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZN4iQ3YQZhR/MeNRJNqHF5LW4qaD8ZHCD/KGKnzXrMtV+Pd4EsK+hxZF9+n5ULs3sGsyGtUdwgs06RVm1xpOUHV/0hSX5/81ssmGdzmWAhP46mq+aHbGnxehJXLauwCw==',key_name='tempest-keypair-1194129302',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:27:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-hht84cps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-614700428',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:27:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=abdc34b5-ca82-4d14-8413-e254897676fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "address": "fa:16:3e:99:97:0c", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aab3747-d4", "ovs_interfaceid": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "address": "fa:16:3e:99:97:0c", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aab3747-d4", "ovs_interfaceid": "0aab3747-d4f0-4905-8649-ba13ab4d81b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:97:0c,bridge_name='br-int',has_traffic_filtering=True,id=0aab3747-d4f0-4905-8649-ba13ab4d81b8,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aab3747-d4') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_vif [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:97:0c,bridge_name='br-int',has_traffic_filtering=True,id=0aab3747-d4f0-4905-8649-ba13ab4d81b8,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aab3747-d4') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0aab3747-d4, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:40 user nova-compute[71312]: INFO os_vif [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:97:0c,bridge_name='br-int',has_traffic_filtering=True,id=0aab3747-d4f0-4905-8649-ba13ab4d81b8,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aab3747-d4')
Jul 25 10:28:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqSEhaBk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:28:40 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[daca3631-2a96-4886-83be-266003909087]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:28:40 user nova-compute[71312]: No targets found.
Jul 25 10:28:40 user nova-compute[71312]: iSNS:
Jul 25 10:28:40 user nova-compute[71312]: No targets found.
Jul 25 10:28:40 user nova-compute[71312]: STATIC:
Jul 25 10:28:40 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d
Jul 25 10:28:40 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:28:40 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:28:40 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3
Jul 25 10:28:40 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:28:40 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:28:40 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4
Jul 25 10:28:40 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:28:40 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:28:40 user nova-compute[71312]: FIRMWARE:
Jul 25 10:28:40 user nova-compute[71312]: No targets found.
Jul 25 10:28:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:28:40 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:28:40 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1d77be-e45f-43cd-a510-3a700f06a3cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dfd814-0e9d-40e2-87d2-9786f7ae99ca]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:28:40 user nova-compute[71312]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)
Jul 25 10:28:40 user nova-compute[71312]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:28:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:28:40 user nova-compute[71312]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 (non-flash)
Jul 25 10:28:40 user nova-compute[71312]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:28:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a84e3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.039s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaa2fbf-4817-4c83-9c38-69748a6cf95d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fb13e8-3c53-4a0a-9e22-00cccf8fefbc]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[66055b0b-1ee6-48a1-87d2-ec9a63656a04]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc63246b-24cc-46b1-b6ce-8ce89be75e27 req-22f2819a-bb26-4b09-9598-87c45ae3a98c service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc63246b-24cc-46b1-b6ce-8ce89be75e27 req-22f2819a-bb26-4b09-9598-87c45ae3a98c service nova] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc63246b-24cc-46b1-b6ce-8ce89be75e27 req-22f2819a-bb26-4b09-9598-87c45ae3a98c service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc63246b-24cc-46b1-b6ce-8ce89be75e27 req-22f2819a-bb26-4b09-9598-87c45ae3a98c service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc63246b-24cc-46b1-b6ce-8ce89be75e27 req-22f2819a-bb26-4b09-9598-87c45ae3a98c service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] No waiting events found dispatching network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:28:40 user nova-compute[71312]: WARNING nova.compute.manager [req-dc63246b-24cc-46b1-b6ce-8ce89be75e27 req-22f2819a-bb26-4b09-9598-87c45ae3a98c service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received unexpected event network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 for instance with vm_state building and task_state spawning.
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c798442-4b56-41de-93dc-0a72e7d11c33]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c12a8f-02ba-42e7-a22a-da83a7336a35]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcf5d2b-9446-47dd-bb24-3ba53cc74321]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4, portal: 172.16.0.220,3260]
Jul 25 10:28:40 user nova-compute[71312]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4, portal: 172.16.0.220,3260] successful.
Jul 25 10:28:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:668f4c99-6670-445e-827d-120884481ae4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f987939-bdbe-4eea-8631-a5f605631565]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== disconnect_volume: return (410ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:28:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Deleting instance files /opt/stack/data/nova/instances/abdc34b5-ca82-4d14-8413-e254897676fd_del
Jul 25 10:28:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Deletion of /opt/stack/data/nova/instances/abdc34b5-ca82-4d14-8413-e254897676fd_del complete
Jul 25 10:28:40 user nova-compute[71312]: INFO nova.compute.manager [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Took 2.21 seconds to destroy the instance on the hypervisor.
Jul 25 10:28:40 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:28:40 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:28:41 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Instance destroyed successfully.
Jul 25 10:28:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:41 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Attempting rescue
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71312) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-818f2c65-cdbf-4942-8bf9-fc36bd04b428 req-112aa6e3-b9cb-4a0d-86fc-654601256b32 service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Received event network-vif-plugged-0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-818f2c65-cdbf-4942-8bf9-fc36bd04b428 req-112aa6e3-b9cb-4a0d-86fc-654601256b32 service nova] Acquiring lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-818f2c65-cdbf-4942-8bf9-fc36bd04b428 req-112aa6e3-b9cb-4a0d-86fc-654601256b32 service nova] Lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-818f2c65-cdbf-4942-8bf9-fc36bd04b428 req-112aa6e3-b9cb-4a0d-86fc-654601256b32 service nova] Lock "abdc34b5-ca82-4d14-8413-e254897676fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-818f2c65-cdbf-4942-8bf9-fc36bd04b428 req-112aa6e3-b9cb-4a0d-86fc-654601256b32 service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] No waiting events found dispatching network-vif-plugged-0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:28:41 user nova-compute[71312]: WARNING nova.compute.manager [req-818f2c65-cdbf-4942-8bf9-fc36bd04b428 req-112aa6e3-b9cb-4a0d-86fc-654601256b32 service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Received unexpected event network-vif-plugged-0aab3747-d4f0-4905-8649-ba13ab4d81b8 for instance with vm_state active and task_state deleting.
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 10:28:41 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Creating image(s)
Jul 25 10:28:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "/opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "/opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "/opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.rescue {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.rescue" returned: 0 in 0.055s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'migration_context' on Instance uuid 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Start _get_guest_xml network_info=[{"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "vif_mac": "fa:16:3e:b0:cc:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'resources' on Instance uuid 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'numa_topology' on Instance uuid 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:28:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:28:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1594314963',display_name='tempest-ServerRescueNegativeTestJSON-server-1594314963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1594314963',id=45,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOTw7aSa7h6F/7uKhiDwBlWmJ/sSN7kzsYFrKGR2yh+kin3WzbjCfyDSfskAkmTJV+Aku8s4Q+WazWOnHFLbvcdqaGEVOZTQJn2O8d0oEKEycJI7JVT0wfMRFACKD+Heg==',key_name='tempest-keypair-1613082722',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce6203d47944c3cb5bca9ab1c173192',ramdisk_id='',reservation_id='r-y9ab5bji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1328366493',owner_user_name='tempest-ServerRescueNegativeTestJSON-1328366493-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:26:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc43767776ce4c9daf58530d543b0e3f',uuid=8838dac5-9f12-4e01-9367-ad184cbc00b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "vif_mac": "fa:16:3e:b0:cc:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converting VIF {"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "vif_mac": "fa:16:3e:b0:cc:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:cc:58,bridge_name='br-int',has_traffic_filtering=True,id=e682c004-dec6-4b49-8eed-ae0ea3306002,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape682c004-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'pci_devices' on Instance uuid 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:28:41 user nova-compute[71312]:   <uuid>8838dac5-9f12-4e01-9367-ad184cbc00b6</uuid>
Jul 25 10:28:41 user nova-compute[71312]:   <name>instance-0000002d</name>
Jul 25 10:28:41 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:28:41 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:28:41 user nova-compute[71312]:   <metadata>
Jul 25 10:28:41 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:28:41 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:28:41 user nova-compute[71312]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1594314963</nova:name>
Jul 25 10:28:41 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:28:41</nova:creationTime>
Jul 25 10:28:41 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:28:41 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:28:41 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:28:41 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:28:41 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:28:41 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:28:41 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:28:41 user nova-compute[71312]:       <nova:owner>
Jul 25 10:28:41 user nova-compute[71312]:         <nova:user uuid="fc43767776ce4c9daf58530d543b0e3f">tempest-ServerRescueNegativeTestJSON-1328366493-project-member</nova:user>
Jul 25 10:28:41 user nova-compute[71312]:         <nova:project uuid="3ce6203d47944c3cb5bca9ab1c173192">tempest-ServerRescueNegativeTestJSON-1328366493</nova:project>
Jul 25 10:28:41 user nova-compute[71312]:       </nova:owner>
Jul 25 10:28:41 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:28:41 user nova-compute[71312]:       <nova:ports>
Jul 25 10:28:41 user nova-compute[71312]:         <nova:port uuid="e682c004-dec6-4b49-8eed-ae0ea3306002">
Jul 25 10:28:41 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 25 10:28:41 user nova-compute[71312]:         </nova:port>
Jul 25 10:28:41 user nova-compute[71312]:       </nova:ports>
Jul 25 10:28:41 user nova-compute[71312]:     </nova:instance>
Jul 25 10:28:41 user nova-compute[71312]:   </metadata>
Jul 25 10:28:41 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:28:41 user nova-compute[71312]:     <system>
Jul 25 10:28:41 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:28:41 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:28:41 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:28:41 user nova-compute[71312]:       <entry name="serial">8838dac5-9f12-4e01-9367-ad184cbc00b6</entry>
Jul 25 10:28:41 user nova-compute[71312]:       <entry name="uuid">8838dac5-9f12-4e01-9367-ad184cbc00b6</entry>
Jul 25 10:28:41 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:28:41 user nova-compute[71312]:     </system>
Jul 25 10:28:41 user nova-compute[71312]:   </sysinfo>
Jul 25 10:28:41 user nova-compute[71312]:   <os>
Jul 25 10:28:41 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:28:41 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:28:41 user nova-compute[71312]:   </os>
Jul 25 10:28:41 user nova-compute[71312]:   <features>
Jul 25 10:28:41 user nova-compute[71312]:     <acpi/>
Jul 25 10:28:41 user nova-compute[71312]:     <apic/>
Jul 25 10:28:41 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:28:41 user nova-compute[71312]:   </features>
Jul 25 10:28:41 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:28:41 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:28:41 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:28:41 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:28:41 user nova-compute[71312]:   </clock>
Jul 25 10:28:41 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:28:41 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:28:41 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:28:41 user nova-compute[71312]:   </cpu>
Jul 25 10:28:41 user nova-compute[71312]:   <devices>
Jul 25 10:28:41 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:28:41 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:28:41 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.rescue"/>
Jul 25 10:28:41 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:28:41 user nova-compute[71312]:     </disk>
Jul 25 10:28:41 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:28:41 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:28:41 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk"/>
Jul 25 10:28:41 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Jul 25 10:28:41 user nova-compute[71312]:     </disk>
Jul 25 10:28:41 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:28:41 user nova-compute[71312]:       <mac address="fa:16:3e:b0:cc:58"/>
Jul 25 10:28:41 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:28:41 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:28:41 user nova-compute[71312]:       <target dev="tape682c004-de"/>
Jul 25 10:28:41 user nova-compute[71312]:     </interface>
Jul 25 10:28:41 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:28:41 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/console.log" append="off"/>
Jul 25 10:28:41 user nova-compute[71312]:     </serial>
Jul 25 10:28:41 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:28:41 user nova-compute[71312]:     <video>
Jul 25 10:28:41 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:28:41 user nova-compute[71312]:     </video>
Jul 25 10:28:41 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:28:41 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:28:41 user nova-compute[71312]:     </rng>
Jul 25 10:28:41 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:28:41 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:28:41 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:28:41 user nova-compute[71312]:     </memballoon>
Jul 25 10:28:41 user nova-compute[71312]:   </devices>
Jul 25 10:28:41 user nova-compute[71312]: </domain>
Jul 25 10:28:41 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:28:41 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Instance destroyed successfully.
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] No VIF found with MAC fa:16:3e:b0:cc:58, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:28:41 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:28:41 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Took 0.97 seconds to deallocate network for instance.
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-0a939cd0-9b45-44db-a908-e7bd7dd1a558 req-796bb4b2-5056-4e1c-a213-f45cc558a72a service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0a939cd0-9b45-44db-a908-e7bd7dd1a558 req-796bb4b2-5056-4e1c-a213-f45cc558a72a service nova] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0a939cd0-9b45-44db-a908-e7bd7dd1a558 req-796bb4b2-5056-4e1c-a213-f45cc558a72a service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0a939cd0-9b45-44db-a908-e7bd7dd1a558 req-796bb4b2-5056-4e1c-a213-f45cc558a72a service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-0a939cd0-9b45-44db-a908-e7bd7dd1a558 req-796bb4b2-5056-4e1c-a213-f45cc558a72a service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] No waiting events found dispatching network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:28:42 user nova-compute[71312]: WARNING nova.compute.manager [req-0a939cd0-9b45-44db-a908-e7bd7dd1a558 req-796bb4b2-5056-4e1c-a213-f45cc558a72a service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received unexpected event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 for instance with vm_state active and task_state rescuing.
Jul 25 10:28:42 user nova-compute[71312]: INFO nova.compute.manager [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Took 0.81 seconds to detach 1 volumes for instance.
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Deleting volume: 668f4c99-6670-445e-827d-120884481ae4 {{(pid=71312) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-b1935de0-43c4-4377-bc9f-bd5969d654c6 req-60cb0407-85be-45cf-be6b-9bd63ceb916f service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b1935de0-43c4-4377-bc9f-bd5969d654c6 req-60cb0407-85be-45cf-be6b-9bd63ceb916f service nova] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b1935de0-43c4-4377-bc9f-bd5969d654c6 req-60cb0407-85be-45cf-be6b-9bd63ceb916f service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b1935de0-43c4-4377-bc9f-bd5969d654c6 req-60cb0407-85be-45cf-be6b-9bd63ceb916f service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-b1935de0-43c4-4377-bc9f-bd5969d654c6 req-60cb0407-85be-45cf-be6b-9bd63ceb916f service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] No waiting events found dispatching network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:28:42 user nova-compute[71312]: WARNING nova.compute.manager [req-b1935de0-43c4-4377-bc9f-bd5969d654c6 req-60cb0407-85be-45cf-be6b-9bd63ceb916f service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received unexpected event network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 for instance with vm_state building and task_state spawning.
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-b1935de0-43c4-4377-bc9f-bd5969d654c6 req-60cb0407-85be-45cf-be6b-9bd63ceb916f service nova] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Received event network-vif-deleted-0aab3747-d4f0-4905-8649-ba13ab4d81b8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280922.9220064, 945e356f-84fd-4b69-aa58-0b06f8dfe3cb => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:28:42 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] VM Resumed (Lifecycle Event)
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:28:42 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Instance spawned successfully.
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:28:42 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:28:42 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280922.9273896, 945e356f-84fd-4b69-aa58-0b06f8dfe3cb => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:28:42 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] VM Started (Lifecycle Event)
Jul 25 10:28:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:28:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:28:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:43 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:28:43 user nova-compute[71312]: INFO nova.compute.manager [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Took 7.31 seconds to spawn the instance on the hypervisor.
Jul 25 10:28:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:28:43 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:28:43 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:28:43 user nova-compute[71312]: INFO nova.compute.manager [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Took 7.96 seconds to build instance.
Jul 25 10:28:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8ec239c-7464-4814-bd6d-5e3a342fd838 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.065s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:43 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Deleted allocations for instance abdc34b5-ca82-4d14-8413-e254897676fd
Jul 25 10:28:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dbdd77e4-216c-4caf-93fc-abef40fc82ad tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "abdc34b5-ca82-4d14-8413-e254897676fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.556s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-cddc89fd-5c85-4a28-9810-5a29d0e0d841 req-d85b299d-4f09-4397-97c9-4c8b3c5757b1 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cddc89fd-5c85-4a28-9810-5a29d0e0d841 req-d85b299d-4f09-4397-97c9-4c8b3c5757b1 service nova] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cddc89fd-5c85-4a28-9810-5a29d0e0d841 req-d85b299d-4f09-4397-97c9-4c8b3c5757b1 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cddc89fd-5c85-4a28-9810-5a29d0e0d841 req-d85b299d-4f09-4397-97c9-4c8b3c5757b1 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-cddc89fd-5c85-4a28-9810-5a29d0e0d841 req-d85b299d-4f09-4397-97c9-4c8b3c5757b1 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] No waiting events found dispatching network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:28:44 user nova-compute[71312]: WARNING nova.compute.manager [req-cddc89fd-5c85-4a28-9810-5a29d0e0d841 req-d85b299d-4f09-4397-97c9-4c8b3c5757b1 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received unexpected event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 for instance with vm_state active and task_state rescuing.
Jul 25 10:28:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-cddc89fd-5c85-4a28-9810-5a29d0e0d841 req-d85b299d-4f09-4397-97c9-4c8b3c5757b1 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:28:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cddc89fd-5c85-4a28-9810-5a29d0e0d841 req-d85b299d-4f09-4397-97c9-4c8b3c5757b1 service nova] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cddc89fd-5c85-4a28-9810-5a29d0e0d841 req-d85b299d-4f09-4397-97c9-4c8b3c5757b1 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cddc89fd-5c85-4a28-9810-5a29d0e0d841 req-d85b299d-4f09-4397-97c9-4c8b3c5757b1 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-cddc89fd-5c85-4a28-9810-5a29d0e0d841 req-d85b299d-4f09-4397-97c9-4c8b3c5757b1 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] No waiting events found dispatching network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:28:44 user nova-compute[71312]: WARNING nova.compute.manager [req-cddc89fd-5c85-4a28-9810-5a29d0e0d841 req-d85b299d-4f09-4397-97c9-4c8b3c5757b1 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received unexpected event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 for instance with vm_state active and task_state rescuing.
Jul 25 10:28:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Removed pending event for 8838dac5-9f12-4e01-9367-ad184cbc00b6 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 10:28:45 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280925.3825502, 8838dac5-9f12-4e01-9367-ad184cbc00b6 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:28:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] VM Resumed (Lifecycle Event)
Jul 25 10:28:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9ed864e6-9308-46e7-9b32-c0eed4343ee6 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:28:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:28:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:28:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 10:28:45 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280925.384012, 8838dac5-9f12-4e01-9367-ad184cbc00b6 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:28:45 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] VM Started (Lifecycle Event)
Jul 25 10:28:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:28:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:28:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:28:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:28:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:45 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:28:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:28:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:28:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:28:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:28:48 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:28:48 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:28:48 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8296MB free_disk=25.096595764160156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:28:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:28:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:28:48 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:28:48 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:28:48 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 19ed556d-1ecc-4252-bd17-2c8bf555f8be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:28:48 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8838dac5-9f12-4e01-9367-ad184cbc00b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:28:48 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 945e356f-84fd-4b69-aa58-0b06f8dfe3cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:28:48 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:28:48 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:28:48 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:28:48 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:28:48 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:28:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:28:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:28:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:28:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:28:55 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280920.3490276, abdc34b5-ca82-4d14-8413-e254897676fd => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:28:55 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] VM Stopped (Lifecycle Event)
Jul 25 10:28:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a1c02086-df04-487f-b6fd-2fde7c3c0b94 None None] [instance: abdc34b5-ca82-4d14-8413-e254897676fd] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:28:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:29:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:19 user nova-compute[71312]: INFO nova.compute.manager [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Unshelving
Jul 25 10:29:19 user nova-compute[71312]: INFO nova.virt.block_device [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Booting with volume e0ea030e-6877-456c-bfe4-aaecaf996939 at /dev/vda
Jul 25 10:29:19 user nova-compute[71312]: DEBUG os_brick.utils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea11e997-06e1-4d90-bc5e-a8f7f8b1419c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d880f60f-ef56-4c48-9c78-76a7d1646708]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6138e4-d7c7-4ac5-a8c5-da4db6353e21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[71976170-b9bb-44e6-acc2-28cd6b1035cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:29:19 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:29:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca339de-e01d-4140-9c9b-b0e164bd9ab4]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG os_brick.utils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:29:19 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updating existing volume attachment record: b424e2e5-4786-4be2-8cdd-3ba9ef44e8b9 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:29:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:26 user nova-compute[71312]: DEBUG nova.objects.instance [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lazy-loading 'pci_requests' on Instance uuid eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:29:26 user nova-compute[71312]: DEBUG nova.objects.instance [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lazy-loading 'numa_topology' on Instance uuid eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:29:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:29:26 user nova-compute[71312]: INFO nova.compute.claims [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Claim successful on node user
Jul 25 10:29:27 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:29:27 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:29:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:27 user nova-compute[71312]: INFO nova.network.neutron [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updating port e106eac1-ef6b-4663-b6f2-db444d8aefb6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 25 10:29:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:29:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquired lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:29:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:29:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-e4c8e95a-7167-4f55-a810-8a44648e1699 req-a9720a94-9be8-4697-81d1-9c879b080eb0 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-changed-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:29:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-e4c8e95a-7167-4f55-a810-8a44648e1699 req-a9720a94-9be8-4697-81d1-9c879b080eb0 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Refreshing instance network info cache due to event network-changed-e106eac1-ef6b-4663-b6f2-db444d8aefb6. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:29:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e4c8e95a-7167-4f55-a810-8a44648e1699 req-a9720a94-9be8-4697-81d1-9c879b080eb0 service nova] Acquiring lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updating instance_info_cache with network_info: [{"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Releasing lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:29:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Creating image(s)
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Ensure instance console log exists: /opt/stack/data/nova/instances/eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Start _get_guest_xml network_info=[{"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'b424e2e5-4786-4be2-8cdd-3ba9ef44e8b9', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpqXZdIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0ea030e-6877-456c-bfe4-aaecaf996939', 'serial': 'e0ea030e-6877-456c-bfe4-aaecaf996939'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e4c8e95a-7167-4f55-a810-8a44648e1699 req-a9720a94-9be8-4697-81d1-9c879b080eb0 service nova] Acquired lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-e4c8e95a-7167-4f55-a810-8a44648e1699 req-a9720a94-9be8-4697-81d1-9c879b080eb0 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Refreshing network info cache for port e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:29:29 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:29:29 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lazy-loading 'vcpu_model' on Instance uuid eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpqXZdIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:29:29 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:29:29 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:29:29 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0f2517-aa51-44f4-8751-8caabc22356b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:29:29 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.044s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8396c8f-a6ad-4948-b2ef-28b459e8d3a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939] added
Jul 25 10:29:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c57e08-c193-4225-b3f1-54ef0f12fb61]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83e7f8d-817a-4594-a8a2-b27d72b0bb19]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hpqXZdIz {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hpqXZdIz" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f461b3d1-94a7-4f53-999b-113fbe9e5e7e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hpqXZdIz'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[528e5c35-b5cc-4414-904f-24dd4b1cd847]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[db14f6e8-8761-41ae-88c1-f4852787e91c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:29:29 user nova-compute[71312]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:29:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:29:29 user nova-compute[71312]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:29:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0897c70b-2e51-4b49-894f-e63eac52014c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260]
Jul 25 10:29:29 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260] successful.
Jul 25 10:29:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[91612b95-aae2-4f0f-a967-cbeb630cb41e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99015d8-acca-4263-a74c-cc7464edf931]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:29:29 user nova-compute[71312]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:29:29 user nova-compute[71312]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:29:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:29:29 user nova-compute[71312]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:29:29 user nova-compute[71312]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:29:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d6d982-9391-4b38-8063-2f5b7dcfef7a]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-e4c8e95a-7167-4f55-a810-8a44648e1699 req-a9720a94-9be8-4697-81d1-9c879b080eb0 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updated VIF entry in instance network info cache for port e106eac1-ef6b-4663-b6f2-db444d8aefb6. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-e4c8e95a-7167-4f55-a810-8a44648e1699 req-a9720a94-9be8-4697-81d1-9c879b080eb0 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updating instance_info_cache with network_info: [{"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:29:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e4c8e95a-7167-4f55-a810-8a44648e1699 req-a9720a94-9be8-4697-81d1-9c879b080eb0 service nova] Releasing lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpqXZdIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23232303766363261', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232303766363261', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-640868858',display_name='tempest-TestShelveInstance-server-640868858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-640868858',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1889794562',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:25:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='12bafba94e094b77a9c0a19358ab4af3',ramdisk_id='',reservation_id='r-n3bye7vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-354481259',owner_user_name='tempest-TestShelveInstance-354481259-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:29:20Z,user_data=None,user_id='79d1e9b058e541babcbd999c4772e841',uuid=eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Converting VIF {"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3b:21,bridge_name='br-int',has_traffic_filtering=True,id=e106eac1-ef6b-4663-b6f2-db444d8aefb6,network=Network(026a8069-3a0d-4c92-9c23-c6a27f09272e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape106eac1-ef') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG nova.objects.instance [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lazy-loading 'pci_devices' on Instance uuid eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:29:30 user nova-compute[71312]:   <uuid>eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338</uuid>
Jul 25 10:29:30 user nova-compute[71312]:   <name>instance-0000002c</name>
Jul 25 10:29:30 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:29:30 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:29:30 user nova-compute[71312]:   <metadata>
Jul 25 10:29:30 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:29:30 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:29:30 user nova-compute[71312]:       <nova:name>tempest-TestShelveInstance-server-640868858</nova:name>
Jul 25 10:29:30 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:29:29</nova:creationTime>
Jul 25 10:29:30 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:29:30 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:29:30 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:29:30 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:29:30 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:29:30 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:29:30 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:29:30 user nova-compute[71312]:       <nova:owner>
Jul 25 10:29:30 user nova-compute[71312]:         <nova:user uuid="79d1e9b058e541babcbd999c4772e841">tempest-TestShelveInstance-354481259-project-member</nova:user>
Jul 25 10:29:30 user nova-compute[71312]:         <nova:project uuid="12bafba94e094b77a9c0a19358ab4af3">tempest-TestShelveInstance-354481259</nova:project>
Jul 25 10:29:30 user nova-compute[71312]:       </nova:owner>
Jul 25 10:29:30 user nova-compute[71312]:       <nova:ports>
Jul 25 10:29:30 user nova-compute[71312]:         <nova:port uuid="e106eac1-ef6b-4663-b6f2-db444d8aefb6">
Jul 25 10:29:30 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:29:30 user nova-compute[71312]:         </nova:port>
Jul 25 10:29:30 user nova-compute[71312]:       </nova:ports>
Jul 25 10:29:30 user nova-compute[71312]:     </nova:instance>
Jul 25 10:29:30 user nova-compute[71312]:   </metadata>
Jul 25 10:29:30 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:29:30 user nova-compute[71312]:     <system>
Jul 25 10:29:30 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:29:30 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:29:30 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:29:30 user nova-compute[71312]:       <entry name="serial">eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338</entry>
Jul 25 10:29:30 user nova-compute[71312]:       <entry name="uuid">eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338</entry>
Jul 25 10:29:30 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:29:30 user nova-compute[71312]:     </system>
Jul 25 10:29:30 user nova-compute[71312]:   </sysinfo>
Jul 25 10:29:30 user nova-compute[71312]:   <os>
Jul 25 10:29:30 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:29:30 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:29:30 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:29:30 user nova-compute[71312]:   </os>
Jul 25 10:29:30 user nova-compute[71312]:   <features>
Jul 25 10:29:30 user nova-compute[71312]:     <acpi/>
Jul 25 10:29:30 user nova-compute[71312]:     <apic/>
Jul 25 10:29:30 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:29:30 user nova-compute[71312]:   </features>
Jul 25 10:29:30 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:29:30 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:29:30 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:29:30 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:29:30 user nova-compute[71312]:   </clock>
Jul 25 10:29:30 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:29:30 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:29:30 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:29:30 user nova-compute[71312]:   </cpu>
Jul 25 10:29:30 user nova-compute[71312]:   <devices>
Jul 25 10:29:30 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:29:30 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:29:30 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Jul 25 10:29:30 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:29:30 user nova-compute[71312]:       <serial>e0ea030e-6877-456c-bfe4-aaecaf996939</serial>
Jul 25 10:29:30 user nova-compute[71312]:     </disk>
Jul 25 10:29:30 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:29:30 user nova-compute[71312]:       <mac address="fa:16:3e:a6:3b:21"/>
Jul 25 10:29:30 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:29:30 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:29:30 user nova-compute[71312]:       <target dev="tape106eac1-ef"/>
Jul 25 10:29:30 user nova-compute[71312]:     </interface>
Jul 25 10:29:30 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:29:30 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338/console.log" append="off"/>
Jul 25 10:29:30 user nova-compute[71312]:     </serial>
Jul 25 10:29:30 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:29:30 user nova-compute[71312]:     <video>
Jul 25 10:29:30 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:29:30 user nova-compute[71312]:     </video>
Jul 25 10:29:30 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:29:30 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:29:30 user nova-compute[71312]:     </rng>
Jul 25 10:29:30 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:29:30 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:29:30 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:29:30 user nova-compute[71312]:     </memballoon>
Jul 25 10:29:30 user nova-compute[71312]:   </devices>
Jul 25 10:29:30 user nova-compute[71312]: </domain>
Jul 25 10:29:30 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-640868858',display_name='tempest-TestShelveInstance-server-640868858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-640868858',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1889794562',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:25:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='12bafba94e094b77a9c0a19358ab4af3',ramdisk_id='',reservation_id='r-n3bye7vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-354481259',owner_user_name='tempest-TestShelveInstance-354481259-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:29:20Z,user_data=None,user_id='79d1e9b058e541babcbd999c4772e841',uuid=eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Converting VIF {"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3b:21,bridge_name='br-int',has_traffic_filtering=True,id=e106eac1-ef6b-4663-b6f2-db444d8aefb6,network=Network(026a8069-3a0d-4c92-9c23-c6a27f09272e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape106eac1-ef') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG os_vif [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3b:21,bridge_name='br-int',has_traffic_filtering=True,id=e106eac1-ef6b-4663-b6f2-db444d8aefb6,network=Network(026a8069-3a0d-4c92-9c23-c6a27f09272e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape106eac1-ef') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape106eac1-ef, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape106eac1-ef, col_values=(('external_ids', {'iface-id': 'e106eac1-ef6b-4663-b6f2-db444d8aefb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:3b:21', 'vm-uuid': 'eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:30 user nova-compute[71312]: INFO os_vif [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3b:21,bridge_name='br-int',has_traffic_filtering=True,id=e106eac1-ef6b-4663-b6f2-db444d8aefb6,network=Network(026a8069-3a0d-4c92-9c23-c6a27f09272e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape106eac1-ef')
Jul 25 10:29:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:29:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] No VIF found with MAC fa:16:3e:a6:3b:21, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:29:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-639952a5-f194-4fa7-93e8-9ecf6a5c82c9 req-0bcd6486-42db-483d-b2ae-0dfab15c6db8 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:29:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-639952a5-f194-4fa7-93e8-9ecf6a5c82c9 req-0bcd6486-42db-483d-b2ae-0dfab15c6db8 service nova] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-639952a5-f194-4fa7-93e8-9ecf6a5c82c9 req-0bcd6486-42db-483d-b2ae-0dfab15c6db8 service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-639952a5-f194-4fa7-93e8-9ecf6a5c82c9 req-0bcd6486-42db-483d-b2ae-0dfab15c6db8 service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-639952a5-f194-4fa7-93e8-9ecf6a5c82c9 req-0bcd6486-42db-483d-b2ae-0dfab15c6db8 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] No waiting events found dispatching network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:29:32 user nova-compute[71312]: WARNING nova.compute.manager [req-639952a5-f194-4fa7-93e8-9ecf6a5c82c9 req-0bcd6486-42db-483d-b2ae-0dfab15c6db8 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received unexpected event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 10:29:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:33 user nova-compute[71312]: INFO nova.compute.manager [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Terminating instance
Jul 25 10:29:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-8e199850-7262-47ce-b013-1b380251723a req-d2cf3067-d8e8-44ab-8c92-12218ce6ef00 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received event network-vif-unplugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8e199850-7262-47ce-b013-1b380251723a req-d2cf3067-d8e8-44ab-8c92-12218ce6ef00 service nova] Acquiring lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8e199850-7262-47ce-b013-1b380251723a req-d2cf3067-d8e8-44ab-8c92-12218ce6ef00 service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8e199850-7262-47ce-b013-1b380251723a req-d2cf3067-d8e8-44ab-8c92-12218ce6ef00 service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-8e199850-7262-47ce-b013-1b380251723a req-d2cf3067-d8e8-44ab-8c92-12218ce6ef00 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] No waiting events found dispatching network-vif-unplugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-8e199850-7262-47ce-b013-1b380251723a req-d2cf3067-d8e8-44ab-8c92-12218ce6ef00 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received event network-vif-unplugged-559eef7f-1e5c-4d3b-968a-4196be42f303 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:29:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Skipping network cache update for instance because it is being deleted. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9871}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Instance destroyed successfully.
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lazy-loading 'resources' on Instance uuid 19ed556d-1ecc-4252-bd17-2c8bf555f8be {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1060455060',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1060455060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1060455060',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT8DKuSxsIqkBg4nDSuIphsnsU5l/P/yvq/kxh41/jr8G7bNJnPjReVMX2aamSQSnVlgfSABJ0F3O5gvpgVTHa5xUuZTOuZCDxBzN3ZCBPTRPqVc3LkEvS1Wj6gfKL85g==',key_name='tempest-keypair-1762312947',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:24:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-dj350rb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:24:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=19ed556d-1ecc-4252-bd17-2c8bf555f8be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "559eef7f-1e5c-4d3b-968a-4196be42f303", "address": "fa:16:3e:1f:c6:a5", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559eef7f-1e", "ovs_interfaceid": "559eef7f-1e5c-4d3b-968a-4196be42f303", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "559eef7f-1e5c-4d3b-968a-4196be42f303", "address": "fa:16:3e:1f:c6:a5", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559eef7f-1e", "ovs_interfaceid": "559eef7f-1e5c-4d3b-968a-4196be42f303", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:c6:a5,bridge_name='br-int',has_traffic_filtering=True,id=559eef7f-1e5c-4d3b-968a-4196be42f303,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559eef7f-1e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_vif [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:c6:a5,bridge_name='br-int',has_traffic_filtering=True,id=559eef7f-1e5c-4d3b-968a-4196be42f303,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559eef7f-1e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap559eef7f-1e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:34 user nova-compute[71312]: INFO os_vif [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:c6:a5,bridge_name='br-int',has_traffic_filtering=True,id=559eef7f-1e5c-4d3b-968a-4196be42f303,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559eef7f-1e')
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hERVNXLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:29:34 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7153eb-2fc5-4ac7-9403-5ddf6077b55c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:29:34 user nova-compute[71312]: No targets found.
Jul 25 10:29:34 user nova-compute[71312]: iSNS:
Jul 25 10:29:34 user nova-compute[71312]: No targets found.
Jul 25 10:29:34 user nova-compute[71312]: STATIC:
Jul 25 10:29:34 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d
Jul 25 10:29:34 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:29:34 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:29:34 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3
Jul 25 10:29:34 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:29:34 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:29:34 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939
Jul 25 10:29:34 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:29:34 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:29:34 user nova-compute[71312]: FIRMWARE:
Jul 25 10:29:34 user nova-compute[71312]: No targets found.
Jul 25 10:29:34 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:29:34 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:29:34 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b0fc93-bcb5-46f9-843c-49f8ee8ee55e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280974.3106816, eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:29:34 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] VM Resumed (Lifecycle Event)
Jul 25 10:29:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Instance spawned successfully.
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d59ffa0-0479-4896-8b1a-d0f41e39a420]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:29:34 user nova-compute[71312]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:29:34 user nova-compute[71312]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:29:34 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 (non-flash)
Jul 25 10:29:34 user nova-compute[71312]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:29:34 user nova-compute[71312]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:29:34 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a82f3910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b271084a-ce1a-4fd3-9390-a8e566725ac9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:34 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690280974.3118687, eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:29:34 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] VM Started (Lifecycle Event)
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.039s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5209c8da-56e5-4997-83fb-d0f3b95c756b]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eadeedea-2042-4b40-8c64-60de3369ff62 tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.867s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3553f1e-88d2-4d8b-a33c-63421c39947f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-32a99254-a3ed-4f2e-85ae-61b93acb78f3 req-8c94bfb6-0619-425e-b8e3-ec0da025d7f4 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-32a99254-a3ed-4f2e-85ae-61b93acb78f3 req-8c94bfb6-0619-425e-b8e3-ec0da025d7f4 service nova] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-32a99254-a3ed-4f2e-85ae-61b93acb78f3 req-8c94bfb6-0619-425e-b8e3-ec0da025d7f4 service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-32a99254-a3ed-4f2e-85ae-61b93acb78f3 req-8c94bfb6-0619-425e-b8e3-ec0da025d7f4 service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-32a99254-a3ed-4f2e-85ae-61b93acb78f3 req-8c94bfb6-0619-425e-b8e3-ec0da025d7f4 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] No waiting events found dispatching network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:29:34 user nova-compute[71312]: WARNING nova.compute.manager [req-32a99254-a3ed-4f2e-85ae-61b93acb78f3 req-8c94bfb6-0619-425e-b8e3-ec0da025d7f4 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received unexpected event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 for instance with vm_state active and task_state None.
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.068s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[31861a4a-0539-4197-99d8-1fabedbf2d6e]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO87b3ebaf-ccb753b25790e16a', '/dev/disk/by-id/scsi-26363623735336232', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_87b3ebaf') {{(pid=82549) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4747be7c-28dc-411c-b5b7-48335ff76047]: (4, None) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1426a2d-bb1e-4579-b943-b1eeac6134e3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cff741e-591f-4c16-9146-0f2c71710779]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3, portal: 172.16.0.220,3260]
Jul 25 10:29:34 user nova-compute[71312]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3, portal: 172.16.0.220,3260] successful.
Jul 25 10:29:34 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:145feb09-c1a2-4c3a-8973-8b8eb5602eb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ed9f8b-5faf-49c4-8d2e-49aa9b1d1737]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== disconnect_volume: return (381ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:29:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Deleting instance files /opt/stack/data/nova/instances/19ed556d-1ecc-4252-bd17-2c8bf555f8be_del
Jul 25 10:29:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Deletion of /opt/stack/data/nova/instances/19ed556d-1ecc-4252-bd17-2c8bf555f8be_del complete
Jul 25 10:29:34 user nova-compute[71312]: INFO nova.compute.manager [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Took 1.28 seconds to destroy the instance on the hypervisor.
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updating instance_info_cache with network_info: [{"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received event network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Acquiring lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] No waiting events found dispatching network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:29:35 user nova-compute[71312]: WARNING nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received unexpected event network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 for instance with vm_state active and task_state deleting.
Jul 25 10:29:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received event network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Acquiring lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] No waiting events found dispatching network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:29:35 user nova-compute[71312]: WARNING nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received unexpected event network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 for instance with vm_state active and task_state deleting.
Jul 25 10:29:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received event network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Acquiring lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] No waiting events found dispatching network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:29:35 user nova-compute[71312]: WARNING nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received unexpected event network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 for instance with vm_state active and task_state deleting.
Jul 25 10:29:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received event network-vif-unplugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Acquiring lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] No waiting events found dispatching network-vif-unplugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received event network-vif-unplugged-559eef7f-1e5c-4d3b-968a-4196be42f303 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received event network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Acquiring lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] No waiting events found dispatching network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:29:35 user nova-compute[71312]: WARNING nova.compute.manager [req-0564f732-ef84-4487-8883-d799ee5cac90 req-4a768024-6ec7-4c40-9f6d-33e6409eb4b9 service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received unexpected event network-vif-plugged-559eef7f-1e5c-4d3b-968a-4196be42f303 for instance with vm_state active and task_state deleting.
Jul 25 10:29:36 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:29:36 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Took 1.37 seconds to deallocate network for instance.
Jul 25 10:29:36 user nova-compute[71312]: INFO nova.compute.manager [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Took 0.78 seconds to detach 1 volumes for instance.
Jul 25 10:29:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Deleting volume: 145feb09-c1a2-4c3a-8973-8b8eb5602eb3 {{(pid=71312) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 10:29:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:29:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:29:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:37 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:29:37 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:29:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:37 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Deleted allocations for instance 19ed556d-1ecc-4252-bd17-2c8bf555f8be
Jul 25 10:29:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c8fadd03-f6cf-4ac5-a15b-2a0ef21e2b14 tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "19ed556d-1ecc-4252-bd17-2c8bf555f8be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.963s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-a505b11e-6b93-4daa-82cb-287602a150dd req-6ed24dba-4f0b-4a68-9dff-ef63f5e7da3c service nova] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Received event network-vif-deleted-559eef7f-1e5c-4d3b-968a-4196be42f303 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:29:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:29:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:29:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:29:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:29:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:29:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:45 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:29:47 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:29:47 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:29:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8240MB free_disk=25.065902709960938GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8838dac5-9f12-4e01-9367-ad184cbc00b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 945e356f-84fd-4b69-aa58-0b06f8dfe3cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:29:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:29:48 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:29:48 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:29:48 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:29:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:29:49 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690280974.1703544, 19ed556d-1ecc-4252-bd17-2c8bf555f8be => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:29:49 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] VM Stopped (Lifecycle Event)
Jul 25 10:29:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0a59d528-30bf-4108-bc27-310752d2a6d7 None None] [instance: 19ed556d-1ecc-4252-bd17-2c8bf555f8be] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:29:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:29:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:29:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:29:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:29:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:29:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:30:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:30:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:30:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:30:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:30:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'flavor' on Instance uuid 945e356f-84fd-4b69-aa58-0b06f8dfe3cb {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:30 user nova-compute[71312]: INFO nova.compute.manager [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Attaching volume fd15b54e-ece8-4235-aac3-68c0587166b0 to /dev/vdb
Jul 25 10:30:30 user nova-compute[71312]: DEBUG os_brick.utils [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fb3806-17f9-4796-9cba-28888ba06b48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c29a29-3343-4a48-aca7-b51adcd0b437]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[49939035-ba69-40bd-9372-4499cfd751c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cd7c2b-e459-498b-904a-f266dfeb8d92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:30:30 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0515d183-5fb8-4ab8-97bc-ba8739f9403d]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG os_brick.utils [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updating existing volume attachment record: d2be3151-328a-4916-8d88-1f20b0e9c153 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:30:30 user nova-compute[71312]: INFO nova.compute.manager [None req-c0e55c7d-c419-4aa0-8b0e-987b33d83b42 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Unrescuing
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c0e55c7d-c419-4aa0-8b0e-987b33d83b42 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c0e55c7d-c419-4aa0-8b0e-987b33d83b42 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquired lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:30:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c0e55c7d-c419-4aa0-8b0e-987b33d83b42 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:30:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c0e55c7d-c419-4aa0-8b0e-987b33d83b42 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updating instance_info_cache with network_info: [{"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:30:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c0e55c7d-c419-4aa0-8b0e-987b33d83b42 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Releasing lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:30:31 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c0e55c7d-c419-4aa0-8b0e-987b33d83b42 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'flavor' on Instance uuid 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:30:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-95bf8355-4fdf-4661-8187-df0911300777 req-b2959680-3bf8-4303-a7d5-7cf947559bb8 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-vif-unplugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:30:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-95bf8355-4fdf-4661-8187-df0911300777 req-b2959680-3bf8-4303-a7d5-7cf947559bb8 service nova] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-95bf8355-4fdf-4661-8187-df0911300777 req-b2959680-3bf8-4303-a7d5-7cf947559bb8 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-95bf8355-4fdf-4661-8187-df0911300777 req-b2959680-3bf8-4303-a7d5-7cf947559bb8 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-95bf8355-4fdf-4661-8187-df0911300777 req-b2959680-3bf8-4303-a7d5-7cf947559bb8 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] No waiting events found dispatching network-vif-unplugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:30:31 user nova-compute[71312]: WARNING nova.compute.manager [req-95bf8355-4fdf-4661-8187-df0911300777 req-b2959680-3bf8-4303-a7d5-7cf947559bb8 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received unexpected event network-vif-unplugged-e682c004-dec6-4b49-8eed-ae0ea3306002 for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:30:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:31 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Instance destroyed successfully.
Jul 25 10:30:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-376169c7-a2e6-4659-8543-8547dbabbecc req-65d80e4c-7b7e-4eae-8dc0-7a4db1746ae2 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-376169c7-a2e6-4659-8543-8547dbabbecc req-65d80e4c-7b7e-4eae-8dc0-7a4db1746ae2 service nova] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-376169c7-a2e6-4659-8543-8547dbabbecc req-65d80e4c-7b7e-4eae-8dc0-7a4db1746ae2 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-376169c7-a2e6-4659-8543-8547dbabbecc req-65d80e4c-7b7e-4eae-8dc0-7a4db1746ae2 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-376169c7-a2e6-4659-8543-8547dbabbecc req-65d80e4c-7b7e-4eae-8dc0-7a4db1746ae2 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] No waiting events found dispatching network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:30:33 user nova-compute[71312]: WARNING nova.compute.manager [req-376169c7-a2e6-4659-8543-8547dbabbecc req-65d80e4c-7b7e-4eae-8dc0-7a4db1746ae2 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received unexpected event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:30:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-376169c7-a2e6-4659-8543-8547dbabbecc req-65d80e4c-7b7e-4eae-8dc0-7a4db1746ae2 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-376169c7-a2e6-4659-8543-8547dbabbecc req-65d80e4c-7b7e-4eae-8dc0-7a4db1746ae2 service nova] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-376169c7-a2e6-4659-8543-8547dbabbecc req-65d80e4c-7b7e-4eae-8dc0-7a4db1746ae2 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-376169c7-a2e6-4659-8543-8547dbabbecc req-65d80e4c-7b7e-4eae-8dc0-7a4db1746ae2 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-376169c7-a2e6-4659-8543-8547dbabbecc req-65d80e4c-7b7e-4eae-8dc0-7a4db1746ae2 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] No waiting events found dispatching network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:30:33 user nova-compute[71312]: WARNING nova.compute.manager [req-376169c7-a2e6-4659-8543-8547dbabbecc req-65d80e4c-7b7e-4eae-8dc0-7a4db1746ae2 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received unexpected event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 for instance with vm_state rescued and task_state unrescuing.
Jul 25 10:30:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:30:33 user nova-compute[71312]: INFO nova.compute.claims [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Claim successful on node user
Jul 25 10:30:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:30:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:30:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG nova.policy [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b15229b8fb22457ca38b9c5bf2f6dbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55fc0544c744824b3b999ecfcf11e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:30:34 user nova-compute[71312]: INFO nova.virt.block_device [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Booting with volume 061f586d-f94e-4713-9a9c-874aaabcd571 at /dev/vda
Jul 25 10:30:34 user nova-compute[71312]: DEBUG os_brick.utils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd1bccd-834a-42a2-aae7-961704396254]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36b1bcf-659d-46f5-9506-e0a4fd4255c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[281e7b06-d8de-4fe0-bb1e-8ed47fca2233]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd8bc4e-0dbf-40ff-bde0-cb1fdab75c0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:30:34 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:30:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72e383e-dbce-4992-89ca-1ec07123e3ef]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG os_brick.utils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Updating existing volume attachment record: 60c8a221-f23f-4beb-9088-086c100e3ea0 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:30:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Successfully created port: c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Removed pending event for 8838dac5-9f12-4e01-9367-ad184cbc00b6 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690281035.4652457, 8838dac5-9f12-4e01-9367-ad184cbc00b6 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:30:35 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] VM Resumed (Lifecycle Event)
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c0e55c7d-c419-4aa0-8b0e-987b33d83b42 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:30:35 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690281035.4673674, 8838dac5-9f12-4e01-9367-ad184cbc00b6 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:30:35 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] VM Started (Lifecycle Event)
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-1b80927c-a9ee-4ca0-b447-9290373c4369 req-e4a8a2f2-38de-4155-9ef6-d6a466afff02 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1b80927c-a9ee-4ca0-b447-9290373c4369 req-e4a8a2f2-38de-4155-9ef6-d6a466afff02 service nova] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1b80927c-a9ee-4ca0-b447-9290373c4369 req-e4a8a2f2-38de-4155-9ef6-d6a466afff02 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1b80927c-a9ee-4ca0-b447-9290373c4369 req-e4a8a2f2-38de-4155-9ef6-d6a466afff02 service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-1b80927c-a9ee-4ca0-b447-9290373c4369 req-e4a8a2f2-38de-4155-9ef6-d6a466afff02 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] No waiting events found dispatching network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:30:35 user nova-compute[71312]: WARNING nova.compute.manager [req-1b80927c-a9ee-4ca0-b447-9290373c4369 req-e4a8a2f2-38de-4155-9ef6-d6a466afff02 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received unexpected event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 for instance with vm_state active and task_state None.
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Successfully updated port: c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "refresh_cache-7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquired lock "refresh_cache-7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-10cdb6e7-acac-4cc3-92c2-361300ab2b2c req-af4cda2f-93f1-4e90-ba88-4424c6bde945 service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Received event network-changed-c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-10cdb6e7-acac-4cc3-92c2-361300ab2b2c req-af4cda2f-93f1-4e90-ba88-4424c6bde945 service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Refreshing instance network info cache due to event network-changed-c40ad374-7b57-4947-9a72-03ea54186759. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10cdb6e7-acac-4cc3-92c2-361300ab2b2c req-af4cda2f-93f1-4e90-ba88-4424c6bde945 service nova] Acquiring lock "refresh_cache-7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:30:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:30:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Updating instance_info_cache with network_info: [{"id": "c40ad374-7b57-4947-9a72-03ea54186759", "address": "fa:16:3e:61:38:e2", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40ad374-7b", "ovs_interfaceid": "c40ad374-7b57-4947-9a72-03ea54186759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:30:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Releasing lock "refresh_cache-7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:30:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Instance network_info: |[{"id": "c40ad374-7b57-4947-9a72-03ea54186759", "address": "fa:16:3e:61:38:e2", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40ad374-7b", "ovs_interfaceid": "c40ad374-7b57-4947-9a72-03ea54186759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:30:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10cdb6e7-acac-4cc3-92c2-361300ab2b2c req-af4cda2f-93f1-4e90-ba88-4424c6bde945 service nova] Acquired lock "refresh_cache-7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:30:36 user nova-compute[71312]: DEBUG nova.network.neutron [req-10cdb6e7-acac-4cc3-92c2-361300ab2b2c req-af4cda2f-93f1-4e90-ba88-4424c6bde945 service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Refreshing network info cache for port c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:30:36 user nova-compute[71312]: DEBUG nova.network.neutron [req-10cdb6e7-acac-4cc3-92c2-361300ab2b2c req-af4cda2f-93f1-4e90-ba88-4424c6bde945 service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Updated VIF entry in instance network info cache for port c40ad374-7b57-4947-9a72-03ea54186759. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:30:36 user nova-compute[71312]: DEBUG nova.network.neutron [req-10cdb6e7-acac-4cc3-92c2-361300ab2b2c req-af4cda2f-93f1-4e90-ba88-4424c6bde945 service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Updating instance_info_cache with network_info: [{"id": "c40ad374-7b57-4947-9a72-03ea54186759", "address": "fa:16:3e:61:38:e2", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40ad374-7b", "ovs_interfaceid": "c40ad374-7b57-4947-9a72-03ea54186759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:30:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10cdb6e7-acac-4cc3-92c2-361300ab2b2c req-af4cda2f-93f1-4e90-ba88-4424c6bde945 service nova] Releasing lock "refresh_cache-7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:30:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:30:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:30:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BeNarftF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:30:41 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:30:41 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:30:41 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62fafc9-3c63-479d-a0ea-abfc448eb8f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:30:41 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab41cb7-b548-479c-8812-5b255a6285f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0] added
Jul 25 10:30:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc785df3-e7c2-432f-a357-804db8653f99]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[85075c97-99f6-4d75-9424-2381ccabdd6e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BeNarftF {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BeNarftF" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e0c79e-389f-4a42-9e89-08bb8b12795f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BeNarftF'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6052cd-d3b3-4e0c-a27c-dd782d124809]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[84096aa8-805d-4d6c-9020-85e47cda98e8]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:30:41 user nova-compute[71312]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:30:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:30:41 user nova-compute[71312]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:30:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9f061e-d934-42bb-9d3d-83f137a99f7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0, portal: 172.16.0.220,3260]
Jul 25 10:30:41 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0, portal: 172.16.0.220,3260] successful.
Jul 25 10:30:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d7d186-cd73-463a-9f8d-506ed5271fff]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb13150-1301-4494-becc-60ddae7e210f]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:30:41 user nova-compute[71312]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:30:41 user nova-compute[71312]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)
Jul 25 10:30:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:30:41 user nova-compute[71312]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:30:41 user nova-compute[71312]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)
Jul 25 10:30:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4228b651-e1fb-49de-87d8-1ae7b42b9697]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:41 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:30:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:30:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BeNarftF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:30:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:30:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23231643436366239', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:30:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231643436366239', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:30:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'flavor' on Instance uuid 945e356f-84fd-4b69-aa58-0b06f8dfe3cb {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:30:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 10:30:43 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:30:43 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:30:43 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:30:43 user nova-compute[71312]:   <serial>fd15b54e-ece8-4235-aac3-68c0587166b0</serial>
Jul 25 10:30:43 user nova-compute[71312]: </disk>
Jul 25 10:30:43 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 10:30:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:30:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:30:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] No VIF found with MAC fa:16:3e:db:35:1e, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:30:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d69f8a9c-742c-4c4e-a479-02788f77ac32 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.296s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:30:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:30:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:30:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Creating image(s)
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Ensure instance console log exists: /opt/stack/data/nova/instances/7f904dd9-4cb1-4c88-85b4-8ac16bc0a282/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Start _get_guest_xml network_info=[{"id": "c40ad374-7b57-4947-9a72-03ea54186759", "address": "fa:16:3e:61:38:e2", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40ad374-7b", "ovs_interfaceid": "c40ad374-7b57-4947-9a72-03ea54186759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '60c8a221-f23f-4beb-9088-086c100e3ea0', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aABoFvsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7f904dd9-4cb1-4c88-85b4-8ac16bc0a282', 'attached_at': '', 'detached_at': '', 'volume_id': '061f586d-f94e-4713-9a9c-874aaabcd571', 'serial': '061f586d-f94e-4713-9a9c-874aaabcd571'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:30:45 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:30:45 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aABoFvsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:30:45 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:30:45 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:30:45 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6108fbcd-f6a7-4024-ab66-7c6e043f5bdb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:30:45 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c98a8a-e057-4934-919f-f2450f3747d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571] added
Jul 25 10:30:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f70b470-b38e-447f-acab-4b5035258a98]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6306da-3c67-4f1c-86f7-4e250ecb673b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aABoFvsR {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aABoFvsR" returned: 0 in 0.032s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[95025f84-b1dd-47d8-91db-8fef06dfb6da]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aABoFvsR'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df29c0e-1ba2-43a3-b47b-56c4f67b57b3]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[358cb86c-6522-4d64-ade8-af0986b1bde8]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:30:45 user nova-compute[71312]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:30:45 user nova-compute[71312]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)
Jul 25 10:30:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:30:45 user nova-compute[71312]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:30:45 user nova-compute[71312]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)
Jul 25 10:30:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9290e847-158f-4261-916c-b34175c9739b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260]
Jul 25 10:30:45 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260] successful.
Jul 25 10:30:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[55185002-9ff7-4bd8-854a-fee4504c5b8e]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3da3a4-ab44-4491-98cb-12f575ba9966]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:30:45 user nova-compute[71312]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:30:45 user nova-compute[71312]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)
Jul 25 10:30:45 user nova-compute[71312]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:30:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:30:45 user nova-compute[71312]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:30:45 user nova-compute[71312]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)
Jul 25 10:30:45 user nova-compute[71312]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:30:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] HCTL ('36', '-', '-', 0) found on session 58 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3585384d-abde-4dc8-bda2-a7ef2187f3c6]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:30:45 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching for a device in session 58 and hctl ['36', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-8882f400-9782-4f77-ac8a-a383f7dfda63 req-f3bb23ae-e822-4fbf-b79b-538f28ecc6c3 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-changed-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-8882f400-9782-4f77-ac8a-a383f7dfda63 req-f3bb23ae-e822-4fbf-b79b-538f28ecc6c3 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Refreshing instance network info cache due to event network-changed-5e5c7cae-cb17-4b6b-8775-39c043df4cb1. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8882f400-9782-4f77-ac8a-a383f7dfda63 req-f3bb23ae-e822-4fbf-b79b-538f28ecc6c3 service nova] Acquiring lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8882f400-9782-4f77-ac8a-a383f7dfda63 req-f3bb23ae-e822-4fbf-b79b-538f28ecc6c3 service nova] Acquired lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-8882f400-9782-4f77-ac8a-a383f7dfda63 req-f3bb23ae-e822-4fbf-b79b-538f28ecc6c3 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Refreshing network info cache for port 5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching for a device in session 58 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aABoFvsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23933363565363265', 'path': '/dev/sde'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933363565363265', 'path': '/dev/sde'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:30:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1094921145',display_name='tempest-TestVolumeBootPattern-server-1094921145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1094921145',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ58gOY1gpOMvj/EiDsxdOjUfY11OGPSuA+GqxT7AzdzB8RcuiyhMOzL2fb60k7qwq0j7GQDzCRx0/Eh2wLjaML4Hb7FzYQTNf3zkUR2LuJI3IlnbZbMees+kYGZ2MIH6Q==',key_name='tempest-TestVolumeBootPattern-1416605656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-fntmbrdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:30:34Z,user_data=None,user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=7f904dd9-4cb1-4c88-85b4-8ac16bc0a282,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c40ad374-7b57-4947-9a72-03ea54186759", "address": "fa:16:3e:61:38:e2", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40ad374-7b", "ovs_interfaceid": "c40ad374-7b57-4947-9a72-03ea54186759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "c40ad374-7b57-4947-9a72-03ea54186759", "address": "fa:16:3e:61:38:e2", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40ad374-7b", "ovs_interfaceid": "c40ad374-7b57-4947-9a72-03ea54186759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:38:e2,bridge_name='br-int',has_traffic_filtering=True,id=c40ad374-7b57-4947-9a72-03ea54186759,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40ad374-7b') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.objects.instance [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:30:46 user nova-compute[71312]:   <uuid>7f904dd9-4cb1-4c88-85b4-8ac16bc0a282</uuid>
Jul 25 10:30:46 user nova-compute[71312]:   <name>instance-00000030</name>
Jul 25 10:30:46 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:30:46 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:30:46 user nova-compute[71312]:   <metadata>
Jul 25 10:30:46 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:30:46 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:30:46 user nova-compute[71312]:       <nova:name>tempest-TestVolumeBootPattern-server-1094921145</nova:name>
Jul 25 10:30:46 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:30:45</nova:creationTime>
Jul 25 10:30:46 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:30:46 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:30:46 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:30:46 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:30:46 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:30:46 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:30:46 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:30:46 user nova-compute[71312]:       <nova:owner>
Jul 25 10:30:46 user nova-compute[71312]:         <nova:user uuid="b15229b8fb22457ca38b9c5bf2f6dbc3">tempest-TestVolumeBootPattern-614700428-project-member</nova:user>
Jul 25 10:30:46 user nova-compute[71312]:         <nova:project uuid="e55fc0544c744824b3b999ecfcf11e31">tempest-TestVolumeBootPattern-614700428</nova:project>
Jul 25 10:30:46 user nova-compute[71312]:       </nova:owner>
Jul 25 10:30:46 user nova-compute[71312]:       <nova:ports>
Jul 25 10:30:46 user nova-compute[71312]:         <nova:port uuid="c40ad374-7b57-4947-9a72-03ea54186759">
Jul 25 10:30:46 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 25 10:30:46 user nova-compute[71312]:         </nova:port>
Jul 25 10:30:46 user nova-compute[71312]:       </nova:ports>
Jul 25 10:30:46 user nova-compute[71312]:     </nova:instance>
Jul 25 10:30:46 user nova-compute[71312]:   </metadata>
Jul 25 10:30:46 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:30:46 user nova-compute[71312]:     <system>
Jul 25 10:30:46 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:30:46 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:30:46 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:30:46 user nova-compute[71312]:       <entry name="serial">7f904dd9-4cb1-4c88-85b4-8ac16bc0a282</entry>
Jul 25 10:30:46 user nova-compute[71312]:       <entry name="uuid">7f904dd9-4cb1-4c88-85b4-8ac16bc0a282</entry>
Jul 25 10:30:46 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:30:46 user nova-compute[71312]:     </system>
Jul 25 10:30:46 user nova-compute[71312]:   </sysinfo>
Jul 25 10:30:46 user nova-compute[71312]:   <os>
Jul 25 10:30:46 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:30:46 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:30:46 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:30:46 user nova-compute[71312]:   </os>
Jul 25 10:30:46 user nova-compute[71312]:   <features>
Jul 25 10:30:46 user nova-compute[71312]:     <acpi/>
Jul 25 10:30:46 user nova-compute[71312]:     <apic/>
Jul 25 10:30:46 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:30:46 user nova-compute[71312]:   </features>
Jul 25 10:30:46 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:30:46 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:30:46 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:30:46 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:30:46 user nova-compute[71312]:   </clock>
Jul 25 10:30:46 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:30:46 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:30:46 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:30:46 user nova-compute[71312]:   </cpu>
Jul 25 10:30:46 user nova-compute[71312]:   <devices>
Jul 25 10:30:46 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:30:46 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:30:46 user nova-compute[71312]:       <source dev="/dev/sde"/>
Jul 25 10:30:46 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:30:46 user nova-compute[71312]:       <serial>061f586d-f94e-4713-9a9c-874aaabcd571</serial>
Jul 25 10:30:46 user nova-compute[71312]:     </disk>
Jul 25 10:30:46 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:30:46 user nova-compute[71312]:       <mac address="fa:16:3e:61:38:e2"/>
Jul 25 10:30:46 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:30:46 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:30:46 user nova-compute[71312]:       <target dev="tapc40ad374-7b"/>
Jul 25 10:30:46 user nova-compute[71312]:     </interface>
Jul 25 10:30:46 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:30:46 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/7f904dd9-4cb1-4c88-85b4-8ac16bc0a282/console.log" append="off"/>
Jul 25 10:30:46 user nova-compute[71312]:     </serial>
Jul 25 10:30:46 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:30:46 user nova-compute[71312]:     <video>
Jul 25 10:30:46 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:30:46 user nova-compute[71312]:     </video>
Jul 25 10:30:46 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:30:46 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:30:46 user nova-compute[71312]:     </rng>
Jul 25 10:30:46 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:30:46 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:30:46 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:30:46 user nova-compute[71312]:     </memballoon>
Jul 25 10:30:46 user nova-compute[71312]:   </devices>
Jul 25 10:30:46 user nova-compute[71312]: </domain>
Jul 25 10:30:46 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:30:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1094921145',display_name='tempest-TestVolumeBootPattern-server-1094921145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1094921145',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ58gOY1gpOMvj/EiDsxdOjUfY11OGPSuA+GqxT7AzdzB8RcuiyhMOzL2fb60k7qwq0j7GQDzCRx0/Eh2wLjaML4Hb7FzYQTNf3zkUR2LuJI3IlnbZbMees+kYGZ2MIH6Q==',key_name='tempest-TestVolumeBootPattern-1416605656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-fntmbrdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:30:34Z,user_data=None,user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=7f904dd9-4cb1-4c88-85b4-8ac16bc0a282,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c40ad374-7b57-4947-9a72-03ea54186759", "address": "fa:16:3e:61:38:e2", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40ad374-7b", "ovs_interfaceid": "c40ad374-7b57-4947-9a72-03ea54186759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "c40ad374-7b57-4947-9a72-03ea54186759", "address": "fa:16:3e:61:38:e2", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40ad374-7b", "ovs_interfaceid": "c40ad374-7b57-4947-9a72-03ea54186759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:38:e2,bridge_name='br-int',has_traffic_filtering=True,id=c40ad374-7b57-4947-9a72-03ea54186759,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40ad374-7b') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG os_vif [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:38:e2,bridge_name='br-int',has_traffic_filtering=True,id=c40ad374-7b57-4947-9a72-03ea54186759,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40ad374-7b') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc40ad374-7b, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc40ad374-7b, col_values=(('external_ids', {'iface-id': 'c40ad374-7b57-4947-9a72-03ea54186759', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:38:e2', 'vm-uuid': '7f904dd9-4cb1-4c88-85b4-8ac16bc0a282'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:46 user nova-compute[71312]: INFO os_vif [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:38:e2,bridge_name='br-int',has_traffic_filtering=True,id=c40ad374-7b57-4947-9a72-03ea54186759,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40ad374-7b')
Jul 25 10:30:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:30:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] No VIF found with MAC fa:16:3e:61:38:e2, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:30:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-8882f400-9782-4f77-ac8a-a383f7dfda63 req-f3bb23ae-e822-4fbf-b79b-538f28ecc6c3 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updated VIF entry in instance network info cache for port 5e5c7cae-cb17-4b6b-8775-39c043df4cb1. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:30:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-8882f400-9782-4f77-ac8a-a383f7dfda63 req-f3bb23ae-e822-4fbf-b79b-538f28ecc6c3 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updating instance_info_cache with network_info: [{"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:30:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8882f400-9782-4f77-ac8a-a383f7dfda63 req-f3bb23ae-e822-4fbf-b79b-538f28ecc6c3 service nova] Releasing lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-f3fa0964-a701-4e7d-983a-d938d586c115 req-0af72352-cee1-4760-8604-97c01a52eb1c service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Received event network-vif-plugged-c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3fa0964-a701-4e7d-983a-d938d586c115 req-0af72352-cee1-4760-8604-97c01a52eb1c service nova] Acquiring lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3fa0964-a701-4e7d-983a-d938d586c115 req-0af72352-cee1-4760-8604-97c01a52eb1c service nova] Lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3fa0964-a701-4e7d-983a-d938d586c115 req-0af72352-cee1-4760-8604-97c01a52eb1c service nova] Lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-f3fa0964-a701-4e7d-983a-d938d586c115 req-0af72352-cee1-4760-8604-97c01a52eb1c service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] No waiting events found dispatching network-vif-plugged-c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:30:48 user nova-compute[71312]: WARNING nova.compute.manager [req-f3fa0964-a701-4e7d-983a-d938d586c115 req-0af72352-cee1-4760-8604-97c01a52eb1c service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Received unexpected event network-vif-plugged-c40ad374-7b57-4947-9a72-03ea54186759 for instance with vm_state building and task_state spawning.
Jul 25 10:30:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-f3fa0964-a701-4e7d-983a-d938d586c115 req-0af72352-cee1-4760-8604-97c01a52eb1c service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Received event network-vif-plugged-c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3fa0964-a701-4e7d-983a-d938d586c115 req-0af72352-cee1-4760-8604-97c01a52eb1c service nova] Acquiring lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3fa0964-a701-4e7d-983a-d938d586c115 req-0af72352-cee1-4760-8604-97c01a52eb1c service nova] Lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3fa0964-a701-4e7d-983a-d938d586c115 req-0af72352-cee1-4760-8604-97c01a52eb1c service nova] Lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-f3fa0964-a701-4e7d-983a-d938d586c115 req-0af72352-cee1-4760-8604-97c01a52eb1c service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] No waiting events found dispatching network-vif-plugged-c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:30:48 user nova-compute[71312]: WARNING nova.compute.manager [req-f3fa0964-a701-4e7d-983a-d938d586c115 req-0af72352-cee1-4760-8604-97c01a52eb1c service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Received unexpected event network-vif-plugged-c40ad374-7b57-4947-9a72-03ea54186759 for instance with vm_state building and task_state spawning.
Jul 25 10:30:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-573871ac-4a7b-4f56-8880-783ca30026df req-1e8ce5da-73eb-4bf1-8650-a61ff017d4c2 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-changed-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-573871ac-4a7b-4f56-8880-783ca30026df req-1e8ce5da-73eb-4bf1-8650-a61ff017d4c2 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Refreshing instance network info cache due to event network-changed-5e5c7cae-cb17-4b6b-8775-39c043df4cb1. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-573871ac-4a7b-4f56-8880-783ca30026df req-1e8ce5da-73eb-4bf1-8650-a61ff017d4c2 service nova] Acquiring lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-573871ac-4a7b-4f56-8880-783ca30026df req-1e8ce5da-73eb-4bf1-8650-a61ff017d4c2 service nova] Acquired lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG nova.network.neutron [req-573871ac-4a7b-4f56-8880-783ca30026df req-1e8ce5da-73eb-4bf1-8650-a61ff017d4c2 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Refreshing network info cache for port 5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f8daff8-86de-4d4c-b795-55f72f179769 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f8daff8-86de-4d4c-b795-55f72f179769 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:49 user nova-compute[71312]: INFO nova.compute.manager [None req-0f8daff8-86de-4d4c-b795-55f72f179769 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Rebooting instance
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f8daff8-86de-4d4c-b795-55f72f179769 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-573871ac-4a7b-4f56-8880-783ca30026df req-1e8ce5da-73eb-4bf1-8650-a61ff017d4c2 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updated VIF entry in instance network info cache for port 5e5c7cae-cb17-4b6b-8775-39c043df4cb1. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-573871ac-4a7b-4f56-8880-783ca30026df req-1e8ce5da-73eb-4bf1-8650-a61ff017d4c2 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updating instance_info_cache with network_info: [{"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-573871ac-4a7b-4f56-8880-783ca30026df req-1e8ce5da-73eb-4bf1-8650-a61ff017d4c2 service nova] Releasing lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f8daff8-86de-4d4c-b795-55f72f179769 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquired lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0f8daff8-86de-4d4c-b795-55f72f179769 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:30:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0f8daff8-86de-4d4c-b795-55f72f179769 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updating instance_info_cache with network_info: [{"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f8daff8-86de-4d4c-b795-55f72f179769 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Releasing lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0f8daff8-86de-4d4c-b795-55f72f179769 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690281050.3395698, 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:30:50 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] VM Resumed (Lifecycle Event)
Jul 25 10:30:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:30:50 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:30:50 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8175MB free_disk=25.05548095703125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:30:50 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Instance spawned successfully.
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:30:50 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690281050.3405898, 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:30:50 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] VM Started (Lifecycle Event)
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:30:50 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8838dac5-9f12-4e01-9367-ad184cbc00b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 945e356f-84fd-4b69-aa58-0b06f8dfe3cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:30:50 user nova-compute[71312]: INFO nova.compute.manager [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Took 5.40 seconds to spawn the instance on the hypervisor.
Jul 25 10:30:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:30:50 user nova-compute[71312]: INFO nova.compute.manager [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Took 17.31 seconds to build instance.
Jul 25 10:30:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-234839ca-3c38-4114-a35b-0390be49292b tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.434s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:51 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:30:51 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:30:51 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:30:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-b087fcf1-a835-45ed-9950-cb5ef682bbeb req-9a045487-f7a0-42a0-9020-121d9730b79b service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-vif-unplugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:30:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b087fcf1-a835-45ed-9950-cb5ef682bbeb req-9a045487-f7a0-42a0-9020-121d9730b79b service nova] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b087fcf1-a835-45ed-9950-cb5ef682bbeb req-9a045487-f7a0-42a0-9020-121d9730b79b service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b087fcf1-a835-45ed-9950-cb5ef682bbeb req-9a045487-f7a0-42a0-9020-121d9730b79b service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-b087fcf1-a835-45ed-9950-cb5ef682bbeb req-9a045487-f7a0-42a0-9020-121d9730b79b service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] No waiting events found dispatching network-vif-unplugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:30:52 user nova-compute[71312]: WARNING nova.compute.manager [req-b087fcf1-a835-45ed-9950-cb5ef682bbeb req-9a045487-f7a0-42a0-9020-121d9730b79b service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received unexpected event network-vif-unplugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 for instance with vm_state active and task_state reboot_started.
Jul 25 10:30:53 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0f8daff8-86de-4d4c-b795-55f72f179769 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Instance shutdown successfully.
Jul 25 10:30:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:30:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:30:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:30:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-469e1e55-870e-47fb-b279-81c25057e2b4 req-8a83b837-64bc-409c-a311-2e0dbb5d3a24 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:30:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-469e1e55-870e-47fb-b279-81c25057e2b4 req-8a83b837-64bc-409c-a311-2e0dbb5d3a24 service nova] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-469e1e55-870e-47fb-b279-81c25057e2b4 req-8a83b837-64bc-409c-a311-2e0dbb5d3a24 service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-469e1e55-870e-47fb-b279-81c25057e2b4 req-8a83b837-64bc-409c-a311-2e0dbb5d3a24 service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-469e1e55-870e-47fb-b279-81c25057e2b4 req-8a83b837-64bc-409c-a311-2e0dbb5d3a24 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] No waiting events found dispatching network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:30:54 user nova-compute[71312]: WARNING nova.compute.manager [req-469e1e55-870e-47fb-b279-81c25057e2b4 req-8a83b837-64bc-409c-a311-2e0dbb5d3a24 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received unexpected event network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 for instance with vm_state active and task_state reboot_started.
Jul 25 10:30:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Removed pending event for 945e356f-84fd-4b69-aa58-0b06f8dfe3cb due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690281056.6682277, 945e356f-84fd-4b69-aa58-0b06f8dfe3cb => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:30:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] VM Resumed (Lifecycle Event)
Jul 25 10:30:56 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Instance running successfully.
Jul 25 10:30:56 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0f8daff8-86de-4d4c-b795-55f72f179769 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Instance soft rebooted successfully.
Jul 25 10:30:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0f8daff8-86de-4d4c-b795-55f72f179769 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-5cf636b8-e040-4fce-8e58-c080a5761c86 req-a786bcf9-b279-4cde-8580-d7e8c1e4910e service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cf636b8-e040-4fce-8e58-c080a5761c86 req-a786bcf9-b279-4cde-8580-d7e8c1e4910e service nova] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cf636b8-e040-4fce-8e58-c080a5761c86 req-a786bcf9-b279-4cde-8580-d7e8c1e4910e service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cf636b8-e040-4fce-8e58-c080a5761c86 req-a786bcf9-b279-4cde-8580-d7e8c1e4910e service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-5cf636b8-e040-4fce-8e58-c080a5761c86 req-a786bcf9-b279-4cde-8580-d7e8c1e4910e service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] No waiting events found dispatching network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:30:56 user nova-compute[71312]: WARNING nova.compute.manager [req-5cf636b8-e040-4fce-8e58-c080a5761c86 req-a786bcf9-b279-4cde-8580-d7e8c1e4910e service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received unexpected event network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 for instance with vm_state active and task_state reboot_started.
Jul 25 10:30:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-5cf636b8-e040-4fce-8e58-c080a5761c86 req-a786bcf9-b279-4cde-8580-d7e8c1e4910e service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cf636b8-e040-4fce-8e58-c080a5761c86 req-a786bcf9-b279-4cde-8580-d7e8c1e4910e service nova] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cf636b8-e040-4fce-8e58-c080a5761c86 req-a786bcf9-b279-4cde-8580-d7e8c1e4910e service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cf636b8-e040-4fce-8e58-c080a5761c86 req-a786bcf9-b279-4cde-8580-d7e8c1e4910e service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-5cf636b8-e040-4fce-8e58-c080a5761c86 req-a786bcf9-b279-4cde-8580-d7e8c1e4910e service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] No waiting events found dispatching network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:30:56 user nova-compute[71312]: WARNING nova.compute.manager [req-5cf636b8-e040-4fce-8e58-c080a5761c86 req-a786bcf9-b279-4cde-8580-d7e8c1e4910e service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received unexpected event network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 for instance with vm_state active and task_state reboot_started.
Jul 25 10:30:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:30:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 25 10:30:56 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690281056.671736, 945e356f-84fd-4b69-aa58-0b06f8dfe3cb => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:30:56 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] VM Started (Lifecycle Event)
Jul 25 10:30:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f8daff8-86de-4d4c-b795-55f72f179769 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.358s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:30:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-033106ef-7432-453f-a7e2-0e13acbfa0e9 req-35ea6f53-11a7-419d-b770-9b9ff767b11d service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-changed-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:31:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-033106ef-7432-453f-a7e2-0e13acbfa0e9 req-35ea6f53-11a7-419d-b770-9b9ff767b11d service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Refreshing instance network info cache due to event network-changed-e106eac1-ef6b-4663-b6f2-db444d8aefb6. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:31:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-033106ef-7432-453f-a7e2-0e13acbfa0e9 req-35ea6f53-11a7-419d-b770-9b9ff767b11d service nova] Acquiring lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:31:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-033106ef-7432-453f-a7e2-0e13acbfa0e9 req-35ea6f53-11a7-419d-b770-9b9ff767b11d service nova] Acquired lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:31:10 user nova-compute[71312]: DEBUG nova.network.neutron [req-033106ef-7432-453f-a7e2-0e13acbfa0e9 req-35ea6f53-11a7-419d-b770-9b9ff767b11d service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Refreshing network info cache for port e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:31:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:31:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:31:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:31:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:31:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:31:10 user nova-compute[71312]: INFO nova.compute.manager [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Terminating instance
Jul 25 10:31:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:31:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-033106ef-7432-453f-a7e2-0e13acbfa0e9 req-35ea6f53-11a7-419d-b770-9b9ff767b11d service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updated VIF entry in instance network info cache for port e106eac1-ef6b-4663-b6f2-db444d8aefb6. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-033106ef-7432-453f-a7e2-0e13acbfa0e9 req-35ea6f53-11a7-419d-b770-9b9ff767b11d service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updating instance_info_cache with network_info: [{"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-033106ef-7432-453f-a7e2-0e13acbfa0e9 req-35ea6f53-11a7-419d-b770-9b9ff767b11d service nova] Releasing lock "refresh_cache-eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Instance destroyed successfully.
Jul 25 10:31:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lazy-loading 'resources' on Instance uuid eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T10:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-640868858',display_name='tempest-TestShelveInstance-server-640868858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-640868858',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqxVb5e9N0lVwsLreb6pD+UbhMUEIvVlIpx68ZdnAVOirPmGdfmeDGUtlrFHOvJWy7C0wxrN/ryaek+RqtJYd5hEh+qSczaUBpzQDtxPu/koDkoaIc0jlRLdeFsDW2MYg==',key_name='tempest-TestShelveInstance-1889794562',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:29:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12bafba94e094b77a9c0a19358ab4af3',ramdisk_id='',reservation_id='r-n3bye7vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-354481259',owner_user_name='tempest-TestShelveInstance-354481259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:29:34Z,user_data=None,user_id='79d1e9b058e541babcbd999c4772e841',uuid=eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Converting VIF {"id": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "address": "fa:16:3e:a6:3b:21", "network": {"id": "026a8069-3a0d-4c92-9c23-c6a27f09272e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093073222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12bafba94e094b77a9c0a19358ab4af3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106eac1-ef", "ovs_interfaceid": "e106eac1-ef6b-4663-b6f2-db444d8aefb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3b:21,bridge_name='br-int',has_traffic_filtering=True,id=e106eac1-ef6b-4663-b6f2-db444d8aefb6,network=Network(026a8069-3a0d-4c92-9c23-c6a27f09272e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape106eac1-ef') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_vif [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3b:21,bridge_name='br-int',has_traffic_filtering=True,id=e106eac1-ef6b-4663-b6f2-db444d8aefb6,network=Network(026a8069-3a0d-4c92-9c23-c6a27f09272e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape106eac1-ef') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape106eac1-ef, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:31:11 user nova-compute[71312]: INFO os_vif [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3b:21,bridge_name='br-int',has_traffic_filtering=True,id=e106eac1-ef6b-4663-b6f2-db444d8aefb6,network=Network(026a8069-3a0d-4c92-9c23-c6a27f09272e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape106eac1-ef')
Jul 25 10:31:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpqXZdIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:31:11 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7f2340-4bb9-4309-9919-34d05ce25105]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:31:11 user nova-compute[71312]: No targets found.
Jul 25 10:31:11 user nova-compute[71312]: iSNS:
Jul 25 10:31:11 user nova-compute[71312]: No targets found.
Jul 25 10:31:11 user nova-compute[71312]: STATIC:
Jul 25 10:31:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0
Jul 25 10:31:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:31:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:31:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571
Jul 25 10:31:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:31:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:31:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d
Jul 25 10:31:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:31:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:31:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939
Jul 25 10:31:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:31:11 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:31:11 user nova-compute[71312]: FIRMWARE:
Jul 25 10:31:11 user nova-compute[71312]: No targets found.
Jul 25 10:31:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:31:11 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:31:11 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1452cc-d7e9-42e8-8a04-be3a91b25d3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[389cc5cb-75a2-438e-8b97-d8c74708ea32]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:31:11 user nova-compute[71312]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:31:11 user nova-compute[71312]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)
Jul 25 10:31:11 user nova-compute[71312]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:31:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:31:11 user nova-compute[71312]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 (non-flash)
Jul 25 10:31:11 user nova-compute[71312]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)
Jul 25 10:31:11 user nova-compute[71312]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:31:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9ceec7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fabb81-92e3-43e4-972f-8ef4c83021e1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd69c6c2-18b3-44f7-a508-da8c20174f32]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1d25b0-246b-48a7-a431-82cae435986a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8002f1-ac2f-4f34-9a11-8467c92c9dd1]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23232303766363261', '/dev/disk/by-id/scsi-1SCST_BIOec8abdc5-2207f62ae8e69328', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ec8abdc5') {{(pid=82549) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f2ec6a-fb51-4086-9e94-db7be9849c4f]: (4, None) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[14035f81-2db1-41e5-8043-4daea2a3532d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ee0171-4722-4abd-81ba-b945bc052de9]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260]
Jul 25 10:31:11 user nova-compute[71312]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939, portal: 172.16.0.220,3260] successful.
Jul 25 10:31:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ea030e-6877-456c-bfe4-aaecaf996939 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17db876-6b51-462d-9025-d281b1cf6233]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] <== disconnect_volume: return (343ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:31:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Deleting instance files /opt/stack/data/nova/instances/eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338_del
Jul 25 10:31:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Deletion of /opt/stack/data/nova/instances/eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338_del complete
Jul 25 10:31:11 user nova-compute[71312]: INFO nova.compute.manager [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Took 1.22 seconds to destroy the instance on the hypervisor.
Jul 25 10:31:11 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:31:12 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Took 0.46 seconds to deallocate network for instance.
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-9a21a97e-be15-43b2-8d12-535d3fca0dc5 req-a0217748-65a2-4728-99f5-507f8ef40756 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-deleted-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:31:12 user nova-compute[71312]: INFO nova.compute.manager [req-9a21a97e-be15-43b2-8d12-535d3fca0dc5 req-a0217748-65a2-4728-99f5-507f8ef40756 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Neutron deleted interface e106eac1-ef6b-4663-b6f2-db444d8aefb6; detaching it from the instance and deleting it from the info cache
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.network.neutron [req-9a21a97e-be15-43b2-8d12-535d3fca0dc5 req-a0217748-65a2-4728-99f5-507f8ef40756 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-9a21a97e-be15-43b2-8d12-535d3fca0dc5 req-a0217748-65a2-4728-99f5-507f8ef40756 service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Detach interface failed, port_id=e106eac1-ef6b-4663-b6f2-db444d8aefb6, reason: Instance eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-unplugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] No waiting events found dispatching network-vif-unplugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-unplugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] No waiting events found dispatching network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:31:12 user nova-compute[71312]: WARNING nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received unexpected event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 for instance with vm_state active and task_state deleting.
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] No waiting events found dispatching network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:31:12 user nova-compute[71312]: WARNING nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received unexpected event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 for instance with vm_state active and task_state deleting.
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] No waiting events found dispatching network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:31:12 user nova-compute[71312]: WARNING nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received unexpected event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 for instance with vm_state active and task_state deleting.
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-unplugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] No waiting events found dispatching network-vif-unplugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-unplugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Acquiring lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:31:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] No waiting events found dispatching network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:31:12 user nova-compute[71312]: WARNING nova.compute.manager [req-e84d5381-379b-4cde-9e7f-357fabc38b17 req-d3ce88dc-6546-47cf-9017-bc4634e1bfac service nova] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Received unexpected event network-vif-plugged-e106eac1-ef6b-4663-b6f2-db444d8aefb6 for instance with vm_state active and task_state deleting.
Jul 25 10:31:13 user nova-compute[71312]: INFO nova.compute.manager [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Took 0.79 seconds to detach 1 volumes for instance.
Jul 25 10:31:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Deleting volume: e0ea030e-6877-456c-bfe4-aaecaf996939 {{(pid=71312) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 10:31:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:31:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:31:13 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:31:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:31:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:31:13 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Deleted allocations for instance eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338
Jul 25 10:31:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-35318e37-54e2-41b6-acb0-c2787654569a tempest-TestShelveInstance-354481259 tempest-TestShelveInstance-354481259-project-member] Lock "eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.032s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:31:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:26 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690281071.3731408, eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:31:26 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] VM Stopped (Lifecycle Event)
Jul 25 10:31:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9356662a-094a-49a1-8dc9-985e32349406 None None] [instance: eb6bcf76-7b4a-4ed4-abfd-fd9b1ebe9338] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:31:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:31:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:31:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:31:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 10:31:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:31:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:31:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:31:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lazy-loading 'info_cache' on Instance uuid 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:31:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Updating instance_info_cache with network_info: [{"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:31:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:31:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:31:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:38 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:31:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:31:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:31:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:31:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:31:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:31:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:31:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 10:31:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 10:31:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:31:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:31:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:31:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:31:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:31:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:31:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:31:50 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:31:50 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8148MB free_disk=25.052452087402344GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8838dac5-9f12-4e01-9367-ad184cbc00b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 945e356f-84fd-4b69-aa58-0b06f8dfe3cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing inventories for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Updating ProviderTree inventory for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Updating inventory in ProviderTree for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing aggregate associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing trait associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, traits: COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:31:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:31:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:31:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:31:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:31:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:31:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:31:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 10:31:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:31:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:32:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-e02b0c1f-3871-443c-a335-194fb30393ed req-e277e4cd-f6c8-433b-89e6-eb8654b71097 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-changed-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:32:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-e02b0c1f-3871-443c-a335-194fb30393ed req-e277e4cd-f6c8-433b-89e6-eb8654b71097 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Refreshing instance network info cache due to event network-changed-e682c004-dec6-4b49-8eed-ae0ea3306002. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:32:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e02b0c1f-3871-443c-a335-194fb30393ed req-e277e4cd-f6c8-433b-89e6-eb8654b71097 service nova] Acquiring lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:32:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e02b0c1f-3871-443c-a335-194fb30393ed req-e277e4cd-f6c8-433b-89e6-eb8654b71097 service nova] Acquired lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:32:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-e02b0c1f-3871-443c-a335-194fb30393ed req-e277e4cd-f6c8-433b-89e6-eb8654b71097 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Refreshing network info cache for port e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG nova.network.neutron [req-e02b0c1f-3871-443c-a335-194fb30393ed req-e277e4cd-f6c8-433b-89e6-eb8654b71097 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updated VIF entry in instance network info cache for port e682c004-dec6-4b49-8eed-ae0ea3306002. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG nova.network.neutron [req-e02b0c1f-3871-443c-a335-194fb30393ed req-e277e4cd-f6c8-433b-89e6-eb8654b71097 service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updating instance_info_cache with network_info: [{"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e02b0c1f-3871-443c-a335-194fb30393ed req-e277e4cd-f6c8-433b-89e6-eb8654b71097 service nova] Releasing lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:32:23 user nova-compute[71312]: INFO nova.compute.manager [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Detaching volume 8c8965d2-e64b-4bd3-8aed-62e93b15768d
Jul 25 10:32:23 user nova-compute[71312]: INFO nova.virt.block_device [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Attempting to driver detach volume 8c8965d2-e64b-4bd3-8aed-62e93b15768d from mountpoint /dev/vdb
Jul 25 10:32:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Attempting to detach device vdb from instance 8838dac5-9f12-4e01-9367-ad184cbc00b6 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:32:23 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:32:23 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Jul 25 10:32:23 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:32:23 user nova-compute[71312]:   <serial>8c8965d2-e64b-4bd3-8aed-62e93b15768d</serial>
Jul 25 10:32:23 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:32:23 user nova-compute[71312]: </disk>
Jul 25 10:32:23 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:32:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Successfully detached device vdb from instance 8838dac5-9f12-4e01-9367-ad184cbc00b6 from the persistent domain config.
Jul 25 10:32:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8838dac5-9f12-4e01-9367-ad184cbc00b6 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:32:23 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:32:23 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Jul 25 10:32:23 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:32:23 user nova-compute[71312]:   <serial>8c8965d2-e64b-4bd3-8aed-62e93b15768d</serial>
Jul 25 10:32:23 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:32:23 user nova-compute[71312]: </disk>
Jul 25 10:32:23 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690281143.7446988, 8838dac5-9f12-4e01-9367-ad184cbc00b6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:32:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Successfully detached device vdb from instance 8838dac5-9f12-4e01-9367-ad184cbc00b6 from the live domain config.
Jul 25 10:32:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYZoJglF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:32:23 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d8bfdf-98e2-4edc-ab96-3e06e65df772]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:32:23 user nova-compute[71312]: No targets found.
Jul 25 10:32:23 user nova-compute[71312]: iSNS:
Jul 25 10:32:23 user nova-compute[71312]: No targets found.
Jul 25 10:32:23 user nova-compute[71312]: STATIC:
Jul 25 10:32:23 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0
Jul 25 10:32:23 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:32:23 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:32:23 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571
Jul 25 10:32:23 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:32:23 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:32:23 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d
Jul 25 10:32:23 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:32:23 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:32:23 user nova-compute[71312]: FIRMWARE:
Jul 25 10:32:23 user nova-compute[71312]: No targets found.
Jul 25 10:32:23 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:32:23 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:32:23 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda3caa9-b189-4ab1-889e-5883dc0f8573]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e190f5-3393-476a-8f06-1c4554c0d9d6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:32:23 user nova-compute[71312]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)
Jul 25 10:32:23 user nova-compute[71312]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:32:23 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d (non-flash)
Jul 25 10:32:23 user nova-compute[71312]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)
Jul 25 10:32:23 user nova-compute[71312]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:32:23 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a8631b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7be2ddc-43dc-4e82-ab6d-0acd3f5ef2ed]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7a42a0-6360-4147-82e8-299348b7ed04]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b44d48a-8eb9-451f-9044-19a2668dcea8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5e3696-bbfc-44a9-b1df-4a33e9d44e1a]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c8c6b0-3e5d-41ce-a907-6074ec5939db]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:32:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb1400a-24f9-4f66-a13a-0b2140a870cc]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d, portal: 172.16.0.220,3260]
Jul 25 10:32:24 user nova-compute[71312]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d, portal: 172.16.0.220,3260] successful.
Jul 25 10:32:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c8965d2-e64b-4bd3-8aed-62e93b15768d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab4fb4c-aec5-41de-9bfb-f6f3926ffdb4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] <== disconnect_volume: return (326ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-18a27da4-1cbd-4508-a674-ea34353f805b req-2cd3382a-dddd-47f1-a98f-2c2ea8417e9d service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-changed-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-18a27da4-1cbd-4508-a674-ea34353f805b req-2cd3382a-dddd-47f1-a98f-2c2ea8417e9d service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Refreshing instance network info cache due to event network-changed-e682c004-dec6-4b49-8eed-ae0ea3306002. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18a27da4-1cbd-4508-a674-ea34353f805b req-2cd3382a-dddd-47f1-a98f-2c2ea8417e9d service nova] Acquiring lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18a27da4-1cbd-4508-a674-ea34353f805b req-2cd3382a-dddd-47f1-a98f-2c2ea8417e9d service nova] Acquired lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG nova.network.neutron [req-18a27da4-1cbd-4508-a674-ea34353f805b req-2cd3382a-dddd-47f1-a98f-2c2ea8417e9d service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Refreshing network info cache for port e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'flavor' on Instance uuid 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:32:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ac3014e4-2710-4b6b-b75c-b68ce012e113 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:32:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-18a27da4-1cbd-4508-a674-ea34353f805b req-2cd3382a-dddd-47f1-a98f-2c2ea8417e9d service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updated VIF entry in instance network info cache for port e682c004-dec6-4b49-8eed-ae0ea3306002. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:32:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-18a27da4-1cbd-4508-a674-ea34353f805b req-2cd3382a-dddd-47f1-a98f-2c2ea8417e9d service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updating instance_info_cache with network_info: [{"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:32:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18a27da4-1cbd-4508-a674-ea34353f805b req-2cd3382a-dddd-47f1-a98f-2c2ea8417e9d service nova] Releasing lock "refresh_cache-8838dac5-9f12-4e01-9367-ad184cbc00b6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:32:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-ffa458f3-1c53-4592-8490-4106e17bb6ff req-cf28c3f6-5e40-4902-9580-16f16669f4fd service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Received event network-changed-c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:32:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-ffa458f3-1c53-4592-8490-4106e17bb6ff req-cf28c3f6-5e40-4902-9580-16f16669f4fd service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Refreshing instance network info cache due to event network-changed-c40ad374-7b57-4947-9a72-03ea54186759. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:32:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ffa458f3-1c53-4592-8490-4106e17bb6ff req-cf28c3f6-5e40-4902-9580-16f16669f4fd service nova] Acquiring lock "refresh_cache-7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:32:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ffa458f3-1c53-4592-8490-4106e17bb6ff req-cf28c3f6-5e40-4902-9580-16f16669f4fd service nova] Acquired lock "refresh_cache-7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:32:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-ffa458f3-1c53-4592-8490-4106e17bb6ff req-cf28c3f6-5e40-4902-9580-16f16669f4fd service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Refreshing network info cache for port c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:32:26 user nova-compute[71312]: INFO nova.compute.manager [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Terminating instance
Jul 25 10:32:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG nova.network.neutron [req-ffa458f3-1c53-4592-8490-4106e17bb6ff req-cf28c3f6-5e40-4902-9580-16f16669f4fd service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Updated VIF entry in instance network info cache for port c40ad374-7b57-4947-9a72-03ea54186759. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG nova.network.neutron [req-ffa458f3-1c53-4592-8490-4106e17bb6ff req-cf28c3f6-5e40-4902-9580-16f16669f4fd service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Updating instance_info_cache with network_info: [{"id": "c40ad374-7b57-4947-9a72-03ea54186759", "address": "fa:16:3e:61:38:e2", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40ad374-7b", "ovs_interfaceid": "c40ad374-7b57-4947-9a72-03ea54186759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ffa458f3-1c53-4592-8490-4106e17bb6ff req-cf28c3f6-5e40-4902-9580-16f16669f4fd service nova] Releasing lock "refresh_cache-7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-36e1a037-9d3f-4daf-b67a-460299b8fe2d req-68c46bb5-c1aa-4255-b0a0-4fc4c3e73280 service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Received event network-vif-unplugged-c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-36e1a037-9d3f-4daf-b67a-460299b8fe2d req-68c46bb5-c1aa-4255-b0a0-4fc4c3e73280 service nova] Acquiring lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-36e1a037-9d3f-4daf-b67a-460299b8fe2d req-68c46bb5-c1aa-4255-b0a0-4fc4c3e73280 service nova] Lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-36e1a037-9d3f-4daf-b67a-460299b8fe2d req-68c46bb5-c1aa-4255-b0a0-4fc4c3e73280 service nova] Lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-36e1a037-9d3f-4daf-b67a-460299b8fe2d req-68c46bb5-c1aa-4255-b0a0-4fc4c3e73280 service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] No waiting events found dispatching network-vif-unplugged-c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:32:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-36e1a037-9d3f-4daf-b67a-460299b8fe2d req-68c46bb5-c1aa-4255-b0a0-4fc4c3e73280 service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Received event network-vif-unplugged-c40ad374-7b57-4947-9a72-03ea54186759 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:32:27 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Instance destroyed successfully.
Jul 25 10:32:27 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lazy-loading 'resources' on Instance uuid 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:30:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1094921145',display_name='tempest-TestVolumeBootPattern-server-1094921145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1094921145',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ58gOY1gpOMvj/EiDsxdOjUfY11OGPSuA+GqxT7AzdzB8RcuiyhMOzL2fb60k7qwq0j7GQDzCRx0/Eh2wLjaML4Hb7FzYQTNf3zkUR2LuJI3IlnbZbMees+kYGZ2MIH6Q==',key_name='tempest-TestVolumeBootPattern-1416605656',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:30:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-fntmbrdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:30:51Z,user_data=None,user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=7f904dd9-4cb1-4c88-85b4-8ac16bc0a282,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c40ad374-7b57-4947-9a72-03ea54186759", "address": "fa:16:3e:61:38:e2", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40ad374-7b", "ovs_interfaceid": "c40ad374-7b57-4947-9a72-03ea54186759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "c40ad374-7b57-4947-9a72-03ea54186759", "address": "fa:16:3e:61:38:e2", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40ad374-7b", "ovs_interfaceid": "c40ad374-7b57-4947-9a72-03ea54186759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:38:e2,bridge_name='br-int',has_traffic_filtering=True,id=c40ad374-7b57-4947-9a72-03ea54186759,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40ad374-7b') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_vif [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:38:e2,bridge_name='br-int',has_traffic_filtering=True,id=c40ad374-7b57-4947-9a72-03ea54186759,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40ad374-7b') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc40ad374-7b, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:32:27 user nova-compute[71312]: INFO os_vif [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:38:e2,bridge_name='br-int',has_traffic_filtering=True,id=c40ad374-7b57-4947-9a72-03ea54186759,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40ad374-7b')
Jul 25 10:32:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aABoFvsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:32:27 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2845ac-6bf8-4b3f-9893-71bfa8fb6e8c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:32:27 user nova-compute[71312]: No targets found.
Jul 25 10:32:27 user nova-compute[71312]: iSNS:
Jul 25 10:32:27 user nova-compute[71312]: No targets found.
Jul 25 10:32:27 user nova-compute[71312]: STATIC:
Jul 25 10:32:27 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0
Jul 25 10:32:27 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:32:27 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:32:27 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571
Jul 25 10:32:27 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:32:27 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:32:27 user nova-compute[71312]: FIRMWARE:
Jul 25 10:32:27 user nova-compute[71312]: No targets found.
Jul 25 10:32:27 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:32:27 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:32:27 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[987bc992-bbc4-4c51-9eae-0e848a7460a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18519df-759b-402e-af9d-8154f3895d8c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)
Jul 25 10:32:27 user nova-compute[71312]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:32:27 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)
Jul 25 10:32:27 user nova-compute[71312]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:32:27 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c02981f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571'): ({'sde'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Removing single pathed devices sde {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[152a3ec1-36f8-4d26-a0b4-bca006447269]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef86b524-0819-45e8-a5dc-c60fece466c7]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flushing IO for device /dev/sde {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[accebcf9-a692-4f92-bc73-504e66675c98]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f397db-913c-45d3-b929-1d2e88b8727c]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_1f4d6467', '/dev/disk/by-id/scsi-23933363565363265', '/dev/disk/by-id/scsi-1SCST_BIO1f4d6467-9365e62e9f9fc665') {{(pid=82549) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 10:32:27 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_1f4d6467
Jul 25 10:32:27 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23933363565363265
Jul 25 10:32:27 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO1f4d6467-9365e62e9f9fc665
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d68704d-5eb6-4c75-8016-f94416caa3a4]: (4, None) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[439de2df-5b5c-4747-86a2-9d33d972fe18]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e2607a-e1f9-42d8-b801-771a689df629]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260]
Jul 25 10:32:27 user nova-compute[71312]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260] successful.
Jul 25 10:32:27 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3c2d94-329e-4e57-9595-050f855d2669]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== disconnect_volume: return (317ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:32:27 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Deleting instance files /opt/stack/data/nova/instances/7f904dd9-4cb1-4c88-85b4-8ac16bc0a282_del
Jul 25 10:32:27 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Deletion of /opt/stack/data/nova/instances/7f904dd9-4cb1-4c88-85b4-8ac16bc0a282_del complete
Jul 25 10:32:27 user nova-compute[71312]: INFO nova.compute.manager [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Took 1.23 seconds to destroy the instance on the hypervisor.
Jul 25 10:32:27 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:32:27 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:32:28 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:32:28 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Took 0.80 seconds to deallocate network for instance.
Jul 25 10:32:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-c4d823fe-13d7-4ae5-9f5f-a9f5cc1d8ff0 req-0ff2190a-4118-4eea-912c-16a2924f0455 service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Received event network-vif-deleted-c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:32:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-e5c6ef19-f7cc-4586-998b-5c3a221fdfb6 req-cc67b54b-91be-4ffb-9532-72e9d3fb9080 service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Received event network-vif-plugged-c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:32:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e5c6ef19-f7cc-4586-998b-5c3a221fdfb6 req-cc67b54b-91be-4ffb-9532-72e9d3fb9080 service nova] Acquiring lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:32:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e5c6ef19-f7cc-4586-998b-5c3a221fdfb6 req-cc67b54b-91be-4ffb-9532-72e9d3fb9080 service nova] Lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:32:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e5c6ef19-f7cc-4586-998b-5c3a221fdfb6 req-cc67b54b-91be-4ffb-9532-72e9d3fb9080 service nova] Lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:32:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-e5c6ef19-f7cc-4586-998b-5c3a221fdfb6 req-cc67b54b-91be-4ffb-9532-72e9d3fb9080 service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] No waiting events found dispatching network-vif-plugged-c40ad374-7b57-4947-9a72-03ea54186759 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:32:28 user nova-compute[71312]: WARNING nova.compute.manager [req-e5c6ef19-f7cc-4586-998b-5c3a221fdfb6 req-cc67b54b-91be-4ffb-9532-72e9d3fb9080 service nova] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Received unexpected event network-vif-plugged-c40ad374-7b57-4947-9a72-03ea54186759 for instance with vm_state active and task_state deleting.
Jul 25 10:32:29 user nova-compute[71312]: INFO nova.compute.manager [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Took 0.71 seconds to detach 1 volumes for instance.
Jul 25 10:32:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:32:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:32:29 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:32:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:32:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:32:29 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Deleted allocations for instance 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282
Jul 25 10:32:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b1ca6467-1001-4086-bfb4-0e41dfa8bb8f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "7f904dd9-4cb1-4c88-85b4-8ac16bc0a282" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.121s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:32:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:32:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:32:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:32:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:32:33 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:32:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Updating instance_info_cache with network_info: [{"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:32:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-b92c3f88-c9c0-4961-8b53-511c215bed39" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:32:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:32:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:32:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:32:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-52a8cfa7-340d-4415-b68d-d713d7793826 req-a627840e-6779-42bf-be3c-242de96c7802 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-changed-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:32:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-52a8cfa7-340d-4415-b68d-d713d7793826 req-a627840e-6779-42bf-be3c-242de96c7802 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Refreshing instance network info cache due to event network-changed-5e5c7cae-cb17-4b6b-8775-39c043df4cb1. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:32:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-52a8cfa7-340d-4415-b68d-d713d7793826 req-a627840e-6779-42bf-be3c-242de96c7802 service nova] Acquiring lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:32:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-52a8cfa7-340d-4415-b68d-d713d7793826 req-a627840e-6779-42bf-be3c-242de96c7802 service nova] Acquired lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:32:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-52a8cfa7-340d-4415-b68d-d713d7793826 req-a627840e-6779-42bf-be3c-242de96c7802 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Refreshing network info cache for port 5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-52a8cfa7-340d-4415-b68d-d713d7793826 req-a627840e-6779-42bf-be3c-242de96c7802 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updated VIF entry in instance network info cache for port 5e5c7cae-cb17-4b6b-8775-39c043df4cb1. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-52a8cfa7-340d-4415-b68d-d713d7793826 req-a627840e-6779-42bf-be3c-242de96c7802 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updating instance_info_cache with network_info: [{"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-52a8cfa7-340d-4415-b68d-d713d7793826 req-a627840e-6779-42bf-be3c-242de96c7802 service nova] Releasing lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690281147.2162797, 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:32:42 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] VM Stopped (Lifecycle Event)
Jul 25 10:32:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ebe2f64-fe21-48cf-b982-b2d0e93f28cf req-43eac1f8-0325-4719-ad09-cd6b3e582f7f service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-changed-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ebe2f64-fe21-48cf-b982-b2d0e93f28cf req-43eac1f8-0325-4719-ad09-cd6b3e582f7f service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Refreshing instance network info cache due to event network-changed-5e5c7cae-cb17-4b6b-8775-39c043df4cb1. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ebe2f64-fe21-48cf-b982-b2d0e93f28cf req-43eac1f8-0325-4719-ad09-cd6b3e582f7f service nova] Acquiring lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ebe2f64-fe21-48cf-b982-b2d0e93f28cf req-43eac1f8-0325-4719-ad09-cd6b3e582f7f service nova] Acquired lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-1ebe2f64-fe21-48cf-b982-b2d0e93f28cf req-43eac1f8-0325-4719-ad09-cd6b3e582f7f service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Refreshing network info cache for port 5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-629374b4-6d37-430c-b964-6dffb27f1f01 None None] [instance: 7f904dd9-4cb1-4c88-85b4-8ac16bc0a282] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:32:42 user nova-compute[71312]: INFO nova.compute.manager [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Detaching volume fd15b54e-ece8-4235-aac3-68c0587166b0
Jul 25 10:32:42 user nova-compute[71312]: INFO nova.virt.block_device [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Attempting to driver detach volume fd15b54e-ece8-4235-aac3-68c0587166b0 from mountpoint /dev/vdb
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Attempting to detach device vdb from instance 945e356f-84fd-4b69-aa58-0b06f8dfe3cb from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:32:42 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:32:42 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:32:42 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:32:42 user nova-compute[71312]:   <serial>fd15b54e-ece8-4235-aac3-68c0587166b0</serial>
Jul 25 10:32:42 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:32:42 user nova-compute[71312]: </disk>
Jul 25 10:32:42 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:32:42 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Successfully detached device vdb from instance 945e356f-84fd-4b69-aa58-0b06f8dfe3cb from the persistent domain config.
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 945e356f-84fd-4b69-aa58-0b06f8dfe3cb from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 10:32:42 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:32:42 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Jul 25 10:32:42 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Jul 25 10:32:42 user nova-compute[71312]:   <serial>fd15b54e-ece8-4235-aac3-68c0587166b0</serial>
Jul 25 10:32:42 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 10:32:42 user nova-compute[71312]: </disk>
Jul 25 10:32:42 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-1ebe2f64-fe21-48cf-b982-b2d0e93f28cf req-43eac1f8-0325-4719-ad09-cd6b3e582f7f service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updated VIF entry in instance network info cache for port 5e5c7cae-cb17-4b6b-8775-39c043df4cb1. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-1ebe2f64-fe21-48cf-b982-b2d0e93f28cf req-43eac1f8-0325-4719-ad09-cd6b3e582f7f service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updating instance_info_cache with network_info: [{"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ebe2f64-fe21-48cf-b982-b2d0e93f28cf req-43eac1f8-0325-4719-ad09-cd6b3e582f7f service nova] Releasing lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Received event <DeviceRemovedEvent: 1690281162.989509, 945e356f-84fd-4b69-aa58-0b06f8dfe3cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 945e356f-84fd-4b69-aa58-0b06f8dfe3cb {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 10:32:42 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Successfully detached device vdb from instance 945e356f-84fd-4b69-aa58-0b06f8dfe3cb from the live domain config.
Jul 25 10:32:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BeNarftF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:32:43 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5298348e-3f13-4967-8da5-a28f7fe0584f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:32:43 user nova-compute[71312]: No targets found.
Jul 25 10:32:43 user nova-compute[71312]: iSNS:
Jul 25 10:32:43 user nova-compute[71312]: No targets found.
Jul 25 10:32:43 user nova-compute[71312]: STATIC:
Jul 25 10:32:43 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0
Jul 25 10:32:43 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:32:43 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:32:43 user nova-compute[71312]: FIRMWARE:
Jul 25 10:32:43 user nova-compute[71312]: No targets found.
Jul 25 10:32:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:32:43 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:32:43 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d2b25e-4ba3-4aeb-96b7-46d4d84914f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[456cb3a5-5185-47e0-9ab4-86e897d5549e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)
Jul 25 10:32:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 (non-flash)
Jul 25 10:32:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a85a4ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cd39e9-948a-479e-8958-e814608294ef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30e9129-c41a-4258-902b-08ed4350b172]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1cb861-0ecd-4907-baf7-512ef1300120]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ce64e0-d644-4fc3-9ddd-14ad34c6ef41]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[23532e19-0896-40ee-8685-485c32d28d53]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ba4074-992d-4359-9cbb-82b16c2cccf0]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0, portal: 172.16.0.220,3260]
Jul 25 10:32:43 user nova-compute[71312]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0, portal: 172.16.0.220,3260] successful.
Jul 25 10:32:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd15b54e-ece8-4235-aac3-68c0587166b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec2a3dc-8280-4fb7-b13d-1c713acb53ce]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] <== disconnect_volume: return (305ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:32:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:32:44 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'flavor' on Instance uuid 945e356f-84fd-4b69-aa58-0b06f8dfe3cb {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:32:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2511b9e-5566-4f7b-a947-bbac802276bc tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.673s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:32:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:32:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:32:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:32:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:32:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:32:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:32:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:32:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:32:49 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:32:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:32:51 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:32:51 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:32:51 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8451MB free_disk=25.050636291503906GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 8838dac5-9f12-4e01-9367-ad184cbc00b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 945e356f-84fd-4b69-aa58-0b06f8dfe3cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:32:51 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:32:52 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:32:52 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:32:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:32:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:32:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:32:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:32:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:32:55 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:32:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:33:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:33:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:13 user nova-compute[71312]: INFO nova.compute.manager [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Terminating instance
Jul 25 10:33:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-dd399489-22be-43d1-8358-0063b8ce6296 req-0174c808-20ca-495c-b988-e206d0cffb0f service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-vif-unplugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dd399489-22be-43d1-8358-0063b8ce6296 req-0174c808-20ca-495c-b988-e206d0cffb0f service nova] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dd399489-22be-43d1-8358-0063b8ce6296 req-0174c808-20ca-495c-b988-e206d0cffb0f service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dd399489-22be-43d1-8358-0063b8ce6296 req-0174c808-20ca-495c-b988-e206d0cffb0f service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-dd399489-22be-43d1-8358-0063b8ce6296 req-0174c808-20ca-495c-b988-e206d0cffb0f service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] No waiting events found dispatching network-vif-unplugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-dd399489-22be-43d1-8358-0063b8ce6296 req-0174c808-20ca-495c-b988-e206d0cffb0f service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-vif-unplugged-e682c004-dec6-4b49-8eed-ae0ea3306002 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Instance destroyed successfully.
Jul 25 10:33:14 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'resources' on Instance uuid 8838dac5-9f12-4e01-9367-ad184cbc00b6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:33:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1594314963',display_name='tempest-ServerRescueNegativeTestJSON-server-1594314963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1594314963',id=45,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOTw7aSa7h6F/7uKhiDwBlWmJ/sSN7kzsYFrKGR2yh+kin3WzbjCfyDSfskAkmTJV+Aku8s4Q+WazWOnHFLbvcdqaGEVOZTQJn2O8d0oEKEycJI7JVT0wfMRFACKD+Heg==',key_name='tempest-keypair-1613082722',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:28:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce6203d47944c3cb5bca9ab1c173192',ramdisk_id='',reservation_id='r-y9ab5bji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1328366493',owner_user_name='tempest-ServerRescueNegativeTestJSON-1328366493-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:30:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc43767776ce4c9daf58530d543b0e3f',uuid=8838dac5-9f12-4e01-9367-ad184cbc00b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:33:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converting VIF {"id": "e682c004-dec6-4b49-8eed-ae0ea3306002", "address": "fa:16:3e:b0:cc:58", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape682c004-de", "ovs_interfaceid": "e682c004-dec6-4b49-8eed-ae0ea3306002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:33:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:cc:58,bridge_name='br-int',has_traffic_filtering=True,id=e682c004-dec6-4b49-8eed-ae0ea3306002,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape682c004-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:33:14 user nova-compute[71312]: DEBUG os_vif [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:cc:58,bridge_name='br-int',has_traffic_filtering=True,id=e682c004-dec6-4b49-8eed-ae0ea3306002,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape682c004-de') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:33:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape682c004-de, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:33:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:33:14 user nova-compute[71312]: INFO os_vif [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:cc:58,bridge_name='br-int',has_traffic_filtering=True,id=e682c004-dec6-4b49-8eed-ae0ea3306002,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape682c004-de')
Jul 25 10:33:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Deleting instance files /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6_del
Jul 25 10:33:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Deletion of /opt/stack/data/nova/instances/8838dac5-9f12-4e01-9367-ad184cbc00b6_del complete
Jul 25 10:33:14 user nova-compute[71312]: INFO nova.compute.manager [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 25 10:33:14 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:33:14 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:33:14 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:33:15 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:33:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-83624346-98f7-49cb-ba3e-550a9c78f749 req-7ec5f4f4-bb70-4d89-bb72-c9e8f96a7adb service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-vif-deleted-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:33:15 user nova-compute[71312]: INFO nova.compute.manager [req-83624346-98f7-49cb-ba3e-550a9c78f749 req-7ec5f4f4-bb70-4d89-bb72-c9e8f96a7adb service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Neutron deleted interface e682c004-dec6-4b49-8eed-ae0ea3306002; detaching it from the instance and deleting it from the info cache
Jul 25 10:33:15 user nova-compute[71312]: DEBUG nova.network.neutron [req-83624346-98f7-49cb-ba3e-550a9c78f749 req-7ec5f4f4-bb70-4d89-bb72-c9e8f96a7adb service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:33:15 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Took 1.11 seconds to deallocate network for instance.
Jul 25 10:33:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-83624346-98f7-49cb-ba3e-550a9c78f749 req-7ec5f4f4-bb70-4d89-bb72-c9e8f96a7adb service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Detach interface failed, port_id=e682c004-dec6-4b49-8eed-ae0ea3306002, reason: Instance 8838dac5-9f12-4e01-9367-ad184cbc00b6 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:33:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:15 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:33:15 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:33:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:15 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Deleted allocations for instance 8838dac5-9f12-4e01-9367-ad184cbc00b6
Jul 25 10:33:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e846434d-3160-4b0d-acc1-682e0d8062e2 req-3cebba94-4646-4d23-ab12-dbc5bb0f0a1a service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:33:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e846434d-3160-4b0d-acc1-682e0d8062e2 req-3cebba94-4646-4d23-ab12-dbc5bb0f0a1a service nova] Acquiring lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e846434d-3160-4b0d-acc1-682e0d8062e2 req-3cebba94-4646-4d23-ab12-dbc5bb0f0a1a service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e846434d-3160-4b0d-acc1-682e0d8062e2 req-3cebba94-4646-4d23-ab12-dbc5bb0f0a1a service nova] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e846434d-3160-4b0d-acc1-682e0d8062e2 req-3cebba94-4646-4d23-ab12-dbc5bb0f0a1a service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] No waiting events found dispatching network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:33:15 user nova-compute[71312]: WARNING nova.compute.manager [req-e846434d-3160-4b0d-acc1-682e0d8062e2 req-3cebba94-4646-4d23-ab12-dbc5bb0f0a1a service nova] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Received unexpected event network-vif-plugged-e682c004-dec6-4b49-8eed-ae0ea3306002 for instance with vm_state deleted and task_state None.
Jul 25 10:33:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0bd35313-b3fe-4a6e-91b8-50a1220326a7 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "8838dac5-9f12-4e01-9367-ad184cbc00b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.348s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:33:18 user nova-compute[71312]: INFO nova.compute.claims [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Claim successful on node user
Jul 25 10:33:18 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:33:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:33:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:33:18 user nova-compute[71312]: INFO nova.virt.block_device [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Booting with volume 061f586d-f94e-4713-9a9c-874aaabcd571 at /dev/vda
Jul 25 10:33:18 user nova-compute[71312]: DEBUG nova.policy [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b15229b8fb22457ca38b9c5bf2f6dbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55fc0544c744824b3b999ecfcf11e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG os_brick.utils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[43722a4a-f642-466c-bfec-c488939c220e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c0fe2d-e018-429e-b6f5-985aab6e8a08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb899990-9f72-4606-aea3-dab6c115b1a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcfcd62-9850-44c2-85ac-7bd97eb88841]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:33:19 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:33:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[55169d4f-62b0-468c-825b-cc26db16edda]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG os_brick.utils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Updating existing volume attachment record: a0f2a6bf-60c4-4782-a74f-1913c06be0f9 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Successfully created port: 75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:33:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Successfully updated port: 75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:33:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:33:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquired lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:33:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:33:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-a896775f-9466-471e-ae2f-ff56e00d0417 req-0929ac3a-bfa3-49fc-8cac-4c4f2c5ae483 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Received event network-changed-75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:33:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-a896775f-9466-471e-ae2f-ff56e00d0417 req-0929ac3a-bfa3-49fc-8cac-4c4f2c5ae483 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Refreshing instance network info cache due to event network-changed-75337dc7-36f2-44d5-b3c0-5b749dda87a4. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:33:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a896775f-9466-471e-ae2f-ff56e00d0417 req-0929ac3a-bfa3-49fc-8cac-4c4f2c5ae483 service nova] Acquiring lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:33:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:33:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Updating instance_info_cache with network_info: [{"id": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "address": "fa:16:3e:23:71:c9", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75337dc7-36", "ovs_interfaceid": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:33:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Releasing lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:33:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Instance network_info: |[{"id": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "address": "fa:16:3e:23:71:c9", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75337dc7-36", "ovs_interfaceid": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:33:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a896775f-9466-471e-ae2f-ff56e00d0417 req-0929ac3a-bfa3-49fc-8cac-4c4f2c5ae483 service nova] Acquired lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:33:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-a896775f-9466-471e-ae2f-ff56e00d0417 req-0929ac3a-bfa3-49fc-8cac-4c4f2c5ae483 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Refreshing network info cache for port 75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:33:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-a896775f-9466-471e-ae2f-ff56e00d0417 req-0929ac3a-bfa3-49fc-8cac-4c4f2c5ae483 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Updated VIF entry in instance network info cache for port 75337dc7-36f2-44d5-b3c0-5b749dda87a4. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:33:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-a896775f-9466-471e-ae2f-ff56e00d0417 req-0929ac3a-bfa3-49fc-8cac-4c4f2c5ae483 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Updating instance_info_cache with network_info: [{"id": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "address": "fa:16:3e:23:71:c9", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75337dc7-36", "ovs_interfaceid": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:33:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a896775f-9466-471e-ae2f-ff56e00d0417 req-0929ac3a-bfa3-49fc-8cac-4c4f2c5ae483 service nova] Releasing lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:33:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:33:25 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Creating image(s)
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Ensure instance console log exists: /opt/stack/data/nova/instances/46d26d26-23b4-4a9c-ae16-63dda292a3ed/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Start _get_guest_xml network_info=[{"id": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "address": "fa:16:3e:23:71:c9", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75337dc7-36", "ovs_interfaceid": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'a0f2a6bf-60c4-4782-a74f-1913c06be0f9', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aABoFvsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '46d26d26-23b4-4a9c-ae16-63dda292a3ed', 'attached_at': '', 'detached_at': '', 'volume_id': '061f586d-f94e-4713-9a9c-874aaabcd571', 'serial': '061f586d-f94e-4713-9a9c-874aaabcd571'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:33:25 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:33:25 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aABoFvsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:33:25 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:33:25 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:33:25 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff2fb7b-f9ad-4cb3-95ab-6435d7c7ccb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:33:25 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf4d8ec-81d0-47fb-bb18-6f5e57046cd7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571] added
Jul 25 10:33:25 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdf696a-e151-4fd4-bb2f-645ddf8796a6]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1542feed-951f-4db5-8747-0ee889ee39d4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aABoFvsR {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aABoFvsR" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2c07cc-f19f-4498-85fb-aeda098341d4]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aABoFvsR'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7a8671-a274-4cc7-93a3-bac4564ff86b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8b5ff1-6e55-4c1b-bff7-4a324647de94]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 10:33:25 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 10:33:25 user nova-compute[71312]:  {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:33:25 user nova-compute[71312]: WARNING os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 10:33:25 user nova-compute[71312]: 
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d8b103-f42a-4f03-9a25-8a26d47f44fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260]
Jul 25 10:33:25 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260] successful.
Jul 25 10:33:25 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7548d3-7b09-456e-ab1c-f9e97c6c9a0a]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6905405b-dec0-4cc5-b74d-93235783975e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:33:25 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:33:25 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1709995-dedb-42ab-a62e-ad1a0745d66f]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:33:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aABoFvsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23933363565363265', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933363565363265', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:33:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-221199288',display_name='tempest-TestVolumeBootPattern-server-221199288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-221199288',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ58gOY1gpOMvj/EiDsxdOjUfY11OGPSuA+GqxT7AzdzB8RcuiyhMOzL2fb60k7qwq0j7GQDzCRx0/Eh2wLjaML4Hb7FzYQTNf3zkUR2LuJI3IlnbZbMees+kYGZ2MIH6Q==',key_name='tempest-TestVolumeBootPattern-1416605656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-5w2w6xix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:33:19Z,user_data=None,user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=46d26d26-23b4-4a9c-ae16-63dda292a3ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "address": "fa:16:3e:23:71:c9", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75337dc7-36", "ovs_interfaceid": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "address": "fa:16:3e:23:71:c9", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75337dc7-36", "ovs_interfaceid": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:71:c9,bridge_name='br-int',has_traffic_filtering=True,id=75337dc7-36f2-44d5-b3c0-5b749dda87a4,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75337dc7-36') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lazy-loading 'pci_devices' on Instance uuid 46d26d26-23b4-4a9c-ae16-63dda292a3ed {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:33:26 user nova-compute[71312]:   <uuid>46d26d26-23b4-4a9c-ae16-63dda292a3ed</uuid>
Jul 25 10:33:26 user nova-compute[71312]:   <name>instance-00000031</name>
Jul 25 10:33:26 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:33:26 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:33:26 user nova-compute[71312]:   <metadata>
Jul 25 10:33:26 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:33:26 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:33:26 user nova-compute[71312]:       <nova:name>tempest-TestVolumeBootPattern-server-221199288</nova:name>
Jul 25 10:33:26 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:33:25</nova:creationTime>
Jul 25 10:33:26 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:33:26 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:33:26 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:33:26 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:33:26 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:33:26 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:33:26 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:33:26 user nova-compute[71312]:       <nova:owner>
Jul 25 10:33:26 user nova-compute[71312]:         <nova:user uuid="b15229b8fb22457ca38b9c5bf2f6dbc3">tempest-TestVolumeBootPattern-614700428-project-member</nova:user>
Jul 25 10:33:26 user nova-compute[71312]:         <nova:project uuid="e55fc0544c744824b3b999ecfcf11e31">tempest-TestVolumeBootPattern-614700428</nova:project>
Jul 25 10:33:26 user nova-compute[71312]:       </nova:owner>
Jul 25 10:33:26 user nova-compute[71312]:       <nova:ports>
Jul 25 10:33:26 user nova-compute[71312]:         <nova:port uuid="75337dc7-36f2-44d5-b3c0-5b749dda87a4">
Jul 25 10:33:26 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 10:33:26 user nova-compute[71312]:         </nova:port>
Jul 25 10:33:26 user nova-compute[71312]:       </nova:ports>
Jul 25 10:33:26 user nova-compute[71312]:     </nova:instance>
Jul 25 10:33:26 user nova-compute[71312]:   </metadata>
Jul 25 10:33:26 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:33:26 user nova-compute[71312]:     <system>
Jul 25 10:33:26 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:33:26 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:33:26 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:33:26 user nova-compute[71312]:       <entry name="serial">46d26d26-23b4-4a9c-ae16-63dda292a3ed</entry>
Jul 25 10:33:26 user nova-compute[71312]:       <entry name="uuid">46d26d26-23b4-4a9c-ae16-63dda292a3ed</entry>
Jul 25 10:33:26 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:33:26 user nova-compute[71312]:     </system>
Jul 25 10:33:26 user nova-compute[71312]:   </sysinfo>
Jul 25 10:33:26 user nova-compute[71312]:   <os>
Jul 25 10:33:26 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:33:26 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:33:26 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:33:26 user nova-compute[71312]:   </os>
Jul 25 10:33:26 user nova-compute[71312]:   <features>
Jul 25 10:33:26 user nova-compute[71312]:     <acpi/>
Jul 25 10:33:26 user nova-compute[71312]:     <apic/>
Jul 25 10:33:26 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:33:26 user nova-compute[71312]:   </features>
Jul 25 10:33:26 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:33:26 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:33:26 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:33:26 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:33:26 user nova-compute[71312]:   </clock>
Jul 25 10:33:26 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:33:26 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:33:26 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:33:26 user nova-compute[71312]:   </cpu>
Jul 25 10:33:26 user nova-compute[71312]:   <devices>
Jul 25 10:33:26 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:33:26 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:33:26 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Jul 25 10:33:26 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:33:26 user nova-compute[71312]:       <serial>061f586d-f94e-4713-9a9c-874aaabcd571</serial>
Jul 25 10:33:26 user nova-compute[71312]:     </disk>
Jul 25 10:33:26 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:33:26 user nova-compute[71312]:       <mac address="fa:16:3e:23:71:c9"/>
Jul 25 10:33:26 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:33:26 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:33:26 user nova-compute[71312]:       <target dev="tap75337dc7-36"/>
Jul 25 10:33:26 user nova-compute[71312]:     </interface>
Jul 25 10:33:26 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:33:26 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/46d26d26-23b4-4a9c-ae16-63dda292a3ed/console.log" append="off"/>
Jul 25 10:33:26 user nova-compute[71312]:     </serial>
Jul 25 10:33:26 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:33:26 user nova-compute[71312]:     <video>
Jul 25 10:33:26 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:33:26 user nova-compute[71312]:     </video>
Jul 25 10:33:26 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:33:26 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:33:26 user nova-compute[71312]:     </rng>
Jul 25 10:33:26 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:33:26 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:33:26 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:33:26 user nova-compute[71312]:     </memballoon>
Jul 25 10:33:26 user nova-compute[71312]:   </devices>
Jul 25 10:33:26 user nova-compute[71312]: </domain>
Jul 25 10:33:26 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:33:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-221199288',display_name='tempest-TestVolumeBootPattern-server-221199288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-221199288',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ58gOY1gpOMvj/EiDsxdOjUfY11OGPSuA+GqxT7AzdzB8RcuiyhMOzL2fb60k7qwq0j7GQDzCRx0/Eh2wLjaML4Hb7FzYQTNf3zkUR2LuJI3IlnbZbMees+kYGZ2MIH6Q==',key_name='tempest-TestVolumeBootPattern-1416605656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-5w2w6xix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:33:19Z,user_data=None,user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=46d26d26-23b4-4a9c-ae16-63dda292a3ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "address": "fa:16:3e:23:71:c9", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75337dc7-36", "ovs_interfaceid": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "address": "fa:16:3e:23:71:c9", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75337dc7-36", "ovs_interfaceid": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:71:c9,bridge_name='br-int',has_traffic_filtering=True,id=75337dc7-36f2-44d5-b3c0-5b749dda87a4,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75337dc7-36') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG os_vif [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:71:c9,bridge_name='br-int',has_traffic_filtering=True,id=75337dc7-36f2-44d5-b3c0-5b749dda87a4,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75337dc7-36') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75337dc7-36, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75337dc7-36, col_values=(('external_ids', {'iface-id': '75337dc7-36f2-44d5-b3c0-5b749dda87a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:71:c9', 'vm-uuid': '46d26d26-23b4-4a9c-ae16-63dda292a3ed'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:33:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:27 user nova-compute[71312]: INFO os_vif [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:71:c9,bridge_name='br-int',has_traffic_filtering=True,id=75337dc7-36f2-44d5-b3c0-5b749dda87a4,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75337dc7-36')
Jul 25 10:33:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:33:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] No VIF found with MAC fa:16:3e:23:71:c9, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:33:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-45e4b139-cf5f-4188-8c85-6c2f22de993e req-10513c68-3bb7-4540-a362-e106277738fe service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Received event network-vif-plugged-75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:33:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-45e4b139-cf5f-4188-8c85-6c2f22de993e req-10513c68-3bb7-4540-a362-e106277738fe service nova] Acquiring lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-45e4b139-cf5f-4188-8c85-6c2f22de993e req-10513c68-3bb7-4540-a362-e106277738fe service nova] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-45e4b139-cf5f-4188-8c85-6c2f22de993e req-10513c68-3bb7-4540-a362-e106277738fe service nova] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-45e4b139-cf5f-4188-8c85-6c2f22de993e req-10513c68-3bb7-4540-a362-e106277738fe service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] No waiting events found dispatching network-vif-plugged-75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:33:28 user nova-compute[71312]: WARNING nova.compute.manager [req-45e4b139-cf5f-4188-8c85-6c2f22de993e req-10513c68-3bb7-4540-a362-e106277738fe service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Received unexpected event network-vif-plugged-75337dc7-36f2-44d5-b3c0-5b749dda87a4 for instance with vm_state building and task_state spawning.
Jul 25 10:33:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:29 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690281194.2729917, 8838dac5-9f12-4e01-9367-ad184cbc00b6 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:33:29 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] VM Stopped (Lifecycle Event)
Jul 25 10:33:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4549b034-b34c-4073-9f6c-dfd0025acdca None None] [instance: 8838dac5-9f12-4e01-9367-ad184cbc00b6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690281210.4241443, 46d26d26-23b4-4a9c-ae16-63dda292a3ed => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:33:30 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] VM Resumed (Lifecycle Event)
Jul 25 10:33:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:33:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Instance spawned successfully.
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:33:30 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690281210.4264042, 46d26d26-23b4-4a9c-ae16-63dda292a3ed => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:33:30 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] VM Started (Lifecycle Event)
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:33:30 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:33:30 user nova-compute[71312]: INFO nova.compute.manager [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Took 4.96 seconds to spawn the instance on the hypervisor.
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:33:30 user nova-compute[71312]: INFO nova.compute.manager [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Took 12.12 seconds to build instance.
Jul 25 10:33:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ec4de7c-8656-4887-84a1-0a1b1703473d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.210s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-c9940364-3bb0-4a43-9835-2055f9bce6dc req-47736ef9-dbf4-4ebf-8f8c-5a4de460fee5 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Received event network-vif-plugged-75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c9940364-3bb0-4a43-9835-2055f9bce6dc req-47736ef9-dbf4-4ebf-8f8c-5a4de460fee5 service nova] Acquiring lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c9940364-3bb0-4a43-9835-2055f9bce6dc req-47736ef9-dbf4-4ebf-8f8c-5a4de460fee5 service nova] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c9940364-3bb0-4a43-9835-2055f9bce6dc req-47736ef9-dbf4-4ebf-8f8c-5a4de460fee5 service nova] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-c9940364-3bb0-4a43-9835-2055f9bce6dc req-47736ef9-dbf4-4ebf-8f8c-5a4de460fee5 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] No waiting events found dispatching network-vif-plugged-75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:33:30 user nova-compute[71312]: WARNING nova.compute.manager [req-c9940364-3bb0-4a43-9835-2055f9bce6dc req-47736ef9-dbf4-4ebf-8f8c-5a4de460fee5 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Received unexpected event network-vif-plugged-75337dc7-36f2-44d5-b3c0-5b749dda87a4 for instance with vm_state active and task_state None.
Jul 25 10:33:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:33:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:33:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:33:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:33:33 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:33:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updating instance_info_cache with network_info: [{"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:33:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-945e356f-84fd-4b69-aa58-0b06f8dfe3cb" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:33:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:33:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:33:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:33:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:33:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:33:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:38 user nova-compute[71312]: INFO nova.compute.manager [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Terminating instance
Jul 25 10:33:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-45b47b14-68c9-41eb-b1f4-68de0922cf2e req-95fec13a-e215-4489-9861-6f873c2cb414 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-vif-unplugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-45b47b14-68c9-41eb-b1f4-68de0922cf2e req-95fec13a-e215-4489-9861-6f873c2cb414 service nova] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-45b47b14-68c9-41eb-b1f4-68de0922cf2e req-95fec13a-e215-4489-9861-6f873c2cb414 service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-45b47b14-68c9-41eb-b1f4-68de0922cf2e req-95fec13a-e215-4489-9861-6f873c2cb414 service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-45b47b14-68c9-41eb-b1f4-68de0922cf2e req-95fec13a-e215-4489-9861-6f873c2cb414 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] No waiting events found dispatching network-vif-unplugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-45b47b14-68c9-41eb-b1f4-68de0922cf2e req-95fec13a-e215-4489-9861-6f873c2cb414 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-vif-unplugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:33:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Instance destroyed successfully.
Jul 25 10:33:38 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lazy-loading 'resources' on Instance uuid 945e356f-84fd-4b69-aa58-0b06f8dfe3cb {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:28:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1991218462',display_name='tempest-TestMinimumBasicScenario-server-1991218462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1991218462',id=47,image_ref='d0c6a084-4209-4a0d-bef7-e24c799f1706',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZR7SvHJc/LvHLCxjooonP2PBUXrZEoq00TtogFPSdn5e3sSHuBVRtRmO7cFWlw+3S1MBH80RNnvlKXg5WsdBvrGkeY9bD6j47bUl5W1wIrAmZDnRD5s6s/gjfbCz2YfA==',key_name='tempest-TestMinimumBasicScenario-2038096685',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:28:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d929f478538e4a13808c730ae670e6ac',ramdisk_id='',reservation_id='r-40xc7efc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d0c6a084-4209-4a0d-bef7-e24c799f1706',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1169366909',owner_user_name='tempest-TestMinimumBasicScenario-1169366909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:30:57Z,user_data=None,user_id='12610a082fb54137a6c6752c800bd393',uuid=945e356f-84fd-4b69-aa58-0b06f8dfe3cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converting VIF {"id": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "address": "fa:16:3e:db:35:1e", "network": {"id": "7d68ae70-573e-4c2b-9661-5fae9fdc1fca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1507181962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d929f478538e4a13808c730ae670e6ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5c7cae-cb", "ovs_interfaceid": "5e5c7cae-cb17-4b6b-8775-39c043df4cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:35:1e,bridge_name='br-int',has_traffic_filtering=True,id=5e5c7cae-cb17-4b6b-8775-39c043df4cb1,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5c7cae-cb') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG os_vif [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:35:1e,bridge_name='br-int',has_traffic_filtering=True,id=5e5c7cae-cb17-4b6b-8775-39c043df4cb1,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5c7cae-cb') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e5c7cae-cb, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:33:39 user nova-compute[71312]: INFO os_vif [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:35:1e,bridge_name='br-int',has_traffic_filtering=True,id=5e5c7cae-cb17-4b6b-8775-39c043df4cb1,network=Network(7d68ae70-573e-4c2b-9661-5fae9fdc1fca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5c7cae-cb')
Jul 25 10:33:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Deleting instance files /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb_del
Jul 25 10:33:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Deletion of /opt/stack/data/nova/instances/945e356f-84fd-4b69-aa58-0b06f8dfe3cb_del complete
Jul 25 10:33:39 user nova-compute[71312]: INFO nova.compute.manager [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 25 10:33:39 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:33:39 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:33:39 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:33:39 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:33:39 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Took 0.50 seconds to deallocate network for instance.
Jul 25 10:33:39 user nova-compute[71312]: DEBUG nova.compute.manager [req-d2d6893e-e6fe-46fe-a0fe-612c96aa36eb req-9ea254bb-0eab-4e82-9dfa-52afddc10236 service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-vif-deleted-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:33:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:39 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:33:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:33:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:39 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Deleted allocations for instance 945e356f-84fd-4b69-aa58-0b06f8dfe3cb
Jul 25 10:33:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:33:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:33:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b87eb422-5f8e-464e-ba05-2d67afe951b3 tempest-TestMinimumBasicScenario-1169366909 tempest-TestMinimumBasicScenario-1169366909-project-member] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.723s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-c0f13c45-4ec4-42b3-b349-917da6d6801a req-d4b592c6-d914-4588-8350-f96bf791b43a service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received event network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:33:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c0f13c45-4ec4-42b3-b349-917da6d6801a req-d4b592c6-d914-4588-8350-f96bf791b43a service nova] Acquiring lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c0f13c45-4ec4-42b3-b349-917da6d6801a req-d4b592c6-d914-4588-8350-f96bf791b43a service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c0f13c45-4ec4-42b3-b349-917da6d6801a req-d4b592c6-d914-4588-8350-f96bf791b43a service nova] Lock "945e356f-84fd-4b69-aa58-0b06f8dfe3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-c0f13c45-4ec4-42b3-b349-917da6d6801a req-d4b592c6-d914-4588-8350-f96bf791b43a service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] No waiting events found dispatching network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:33:40 user nova-compute[71312]: WARNING nova.compute.manager [req-c0f13c45-4ec4-42b3-b349-917da6d6801a req-d4b592c6-d914-4588-8350-f96bf791b43a service nova] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Received unexpected event network-vif-plugged-5e5c7cae-cb17-4b6b-8775-39c043df4cb1 for instance with vm_state deleted and task_state None.
Jul 25 10:33:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:33:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:33:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:33:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:33:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:33:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:33:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:33:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:33:52 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:33:52 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:33:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8457MB free_disk=25.096969604492188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:33:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:33:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:33:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:33:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance b92c3f88-c9c0-4961-8b53-511c215bed39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:33:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 46d26d26-23b4-4a9c-ae16-63dda292a3ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:33:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:33:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:33:52 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:33:52 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:33:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:33:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:33:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:33:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:33:53 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690281218.9626899, 945e356f-84fd-4b69-aa58-0b06f8dfe3cb => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:33:53 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] VM Stopped (Lifecycle Event)
Jul 25 10:33:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ed54f361-6060-4cc2-aa50-c502553bca0f None None] [instance: 945e356f-84fd-4b69-aa58-0b06f8dfe3cb] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:33:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:33:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:33:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "b92c3f88-c9c0-4961-8b53-511c215bed39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:34:13 user nova-compute[71312]: INFO nova.compute.manager [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Terminating instance
Jul 25 10:34:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-b5c4e8f1-4b55-4e69-a790-9e301f927937 req-a49bae4a-04e0-441f-b62c-03b213d32532 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received event network-vif-unplugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b5c4e8f1-4b55-4e69-a790-9e301f927937 req-a49bae4a-04e0-441f-b62c-03b213d32532 service nova] Acquiring lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b5c4e8f1-4b55-4e69-a790-9e301f927937 req-a49bae4a-04e0-441f-b62c-03b213d32532 service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b5c4e8f1-4b55-4e69-a790-9e301f927937 req-a49bae4a-04e0-441f-b62c-03b213d32532 service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-b5c4e8f1-4b55-4e69-a790-9e301f927937 req-a49bae4a-04e0-441f-b62c-03b213d32532 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] No waiting events found dispatching network-vif-unplugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-b5c4e8f1-4b55-4e69-a790-9e301f927937 req-a49bae4a-04e0-441f-b62c-03b213d32532 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received event network-vif-unplugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Instance destroyed successfully.
Jul 25 10:34:14 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'resources' on Instance uuid b92c3f88-c9c0-4961-8b53-511c215bed39 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:34:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-408213321',display_name='tempest-ServerRescueNegativeTestJSON-server-408213321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-408213321',id=37,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:20:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce6203d47944c3cb5bca9ab1c173192',ramdisk_id='',reservation_id='r-0osvifav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1328366493',owner_user_name='tempest-ServerRescueNegativeTestJSON-1328366493-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:20:02Z,user_data=None,user_id='fc43767776ce4c9daf58530d543b0e3f',uuid=b92c3f88-c9c0-4961-8b53-511c215bed39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:34:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converting VIF {"id": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "address": "fa:16:3e:01:36:c6", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddfb07b-8e", "ovs_interfaceid": "6ddfb07b-8e9d-48a1-b8c9-96084b7068db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:34:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:36:c6,bridge_name='br-int',has_traffic_filtering=True,id=6ddfb07b-8e9d-48a1-b8c9-96084b7068db,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddfb07b-8e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:34:14 user nova-compute[71312]: DEBUG os_vif [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:36:c6,bridge_name='br-int',has_traffic_filtering=True,id=6ddfb07b-8e9d-48a1-b8c9-96084b7068db,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddfb07b-8e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:34:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ddfb07b-8e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:34:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:34:14 user nova-compute[71312]: INFO os_vif [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:36:c6,bridge_name='br-int',has_traffic_filtering=True,id=6ddfb07b-8e9d-48a1-b8c9-96084b7068db,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddfb07b-8e')
Jul 25 10:34:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Deleting instance files /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39_del
Jul 25 10:34:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Deletion of /opt/stack/data/nova/instances/b92c3f88-c9c0-4961-8b53-511c215bed39_del complete
Jul 25 10:34:14 user nova-compute[71312]: INFO nova.compute.manager [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 25 10:34:14 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:34:14 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:34:14 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:34:15 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:34:15 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Took 0.57 seconds to deallocate network for instance.
Jul 25 10:34:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-2bd958e0-b7d3-4527-885d-3eb956ea6bde req-259ce1e4-8f1f-4e0d-9f16-e5940b23640d service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received event network-vif-deleted-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:34:15 user nova-compute[71312]: INFO nova.compute.manager [req-2bd958e0-b7d3-4527-885d-3eb956ea6bde req-259ce1e4-8f1f-4e0d-9f16-e5940b23640d service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Neutron deleted interface 6ddfb07b-8e9d-48a1-b8c9-96084b7068db; detaching it from the instance and deleting it from the info cache
Jul 25 10:34:15 user nova-compute[71312]: DEBUG nova.network.neutron [req-2bd958e0-b7d3-4527-885d-3eb956ea6bde req-259ce1e4-8f1f-4e0d-9f16-e5940b23640d service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:34:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-2bd958e0-b7d3-4527-885d-3eb956ea6bde req-259ce1e4-8f1f-4e0d-9f16-e5940b23640d service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Detach interface failed, port_id=6ddfb07b-8e9d-48a1-b8c9-96084b7068db, reason: Instance b92c3f88-c9c0-4961-8b53-511c215bed39 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 10:34:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:34:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:34:15 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:34:15 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:34:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:34:15 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Deleted allocations for instance b92c3f88-c9c0-4961-8b53-511c215bed39
Jul 25 10:34:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1be06c5d-ee19-4d35-92ae-f4e3ca7e4430 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.870s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:34:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-0b8765c3-0e54-4324-9522-771be7ccf06d req-3e9193fe-1fc4-481b-9803-ba991ea70a60 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received event network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:34:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0b8765c3-0e54-4324-9522-771be7ccf06d req-3e9193fe-1fc4-481b-9803-ba991ea70a60 service nova] Acquiring lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:34:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0b8765c3-0e54-4324-9522-771be7ccf06d req-3e9193fe-1fc4-481b-9803-ba991ea70a60 service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:34:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0b8765c3-0e54-4324-9522-771be7ccf06d req-3e9193fe-1fc4-481b-9803-ba991ea70a60 service nova] Lock "b92c3f88-c9c0-4961-8b53-511c215bed39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:34:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-0b8765c3-0e54-4324-9522-771be7ccf06d req-3e9193fe-1fc4-481b-9803-ba991ea70a60 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] No waiting events found dispatching network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:34:15 user nova-compute[71312]: WARNING nova.compute.manager [req-0b8765c3-0e54-4324-9522-771be7ccf06d req-3e9193fe-1fc4-481b-9803-ba991ea70a60 service nova] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Received unexpected event network-vif-plugged-6ddfb07b-8e9d-48a1-b8c9-96084b7068db for instance with vm_state deleted and task_state None.
Jul 25 10:34:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:34:29 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690281254.310061, b92c3f88-c9c0-4961-8b53-511c215bed39 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:34:29 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] VM Stopped (Lifecycle Event)
Jul 25 10:34:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-99658ddf-6fe4-4fc9-a259-35432ed79911 None None] [instance: b92c3f88-c9c0-4961-8b53-511c215bed39] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:34:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:34:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:34:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:34:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 10:34:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:34:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:34:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:34:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:34:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:34:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:34:52 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:34:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:34:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:34:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:34:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:34:53 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:34:53 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:34:53 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8688MB free_disk=25.163593292236328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 46d26d26-23b4-4a9c-ae16-63dda292a3ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:34:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:34:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:34:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:34:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:34:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:34:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:35:04 user nova-compute[71312]: INFO nova.compute.manager [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Terminating instance
Jul 25 10:35:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-cb3673d9-8f54-4f39-9601-f7ebe56bdced req-96a9aaeb-e9a9-4882-aa65-7a4cb372cb1d service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-unplugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cb3673d9-8f54-4f39-9601-f7ebe56bdced req-96a9aaeb-e9a9-4882-aa65-7a4cb372cb1d service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cb3673d9-8f54-4f39-9601-f7ebe56bdced req-96a9aaeb-e9a9-4882-aa65-7a4cb372cb1d service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cb3673d9-8f54-4f39-9601-f7ebe56bdced req-96a9aaeb-e9a9-4882-aa65-7a4cb372cb1d service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-cb3673d9-8f54-4f39-9601-f7ebe56bdced req-96a9aaeb-e9a9-4882-aa65-7a4cb372cb1d service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-unplugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:35:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-cb3673d9-8f54-4f39-9601-f7ebe56bdced req-96a9aaeb-e9a9-4882-aa65-7a4cb372cb1d service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-unplugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:35:05 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Instance destroyed successfully.
Jul 25 10:35:05 user nova-compute[71312]: DEBUG nova.objects.instance [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lazy-loading 'resources' on Instance uuid 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:18:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1913416426',display_name='tempest-ServerRescueNegativeTestJSON-server-1913416426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1913416426',id=36,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:22:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce6203d47944c3cb5bca9ab1c173192',ramdisk_id='',reservation_id='r-oatv27me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1328366493',owner_user_name='tempest-ServerRescueNegativeTestJSON-1328366493-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:24:48Z,user_data=None,user_id='fc43767776ce4c9daf58530d543b0e3f',uuid=68165a49-f7f7-48b2-b7a0-34c09c6e8d2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converting VIF {"id": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "address": "fa:16:3e:65:24:56", "network": {"id": "9f854dd3-4158-4962-934c-51c09e0a0ae9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1522823863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce6203d47944c3cb5bca9ab1c173192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b2a233-ed", "ovs_interfaceid": "a2b2a233-ed89-4660-b554-fb9e3260c20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:24:56,bridge_name='br-int',has_traffic_filtering=True,id=a2b2a233-ed89-4660-b554-fb9e3260c20f,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b2a233-ed') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG os_vif [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:24:56,bridge_name='br-int',has_traffic_filtering=True,id=a2b2a233-ed89-4660-b554-fb9e3260c20f,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b2a233-ed') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2b2a233-ed, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:35:05 user nova-compute[71312]: INFO os_vif [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:24:56,bridge_name='br-int',has_traffic_filtering=True,id=a2b2a233-ed89-4660-b554-fb9e3260c20f,network=Network(9f854dd3-4158-4962-934c-51c09e0a0ae9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b2a233-ed')
Jul 25 10:35:05 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Deleting instance files /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f_del
Jul 25 10:35:05 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Deletion of /opt/stack/data/nova/instances/68165a49-f7f7-48b2-b7a0-34c09c6e8d2f_del complete
Jul 25 10:35:05 user nova-compute[71312]: INFO nova.compute.manager [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 25 10:35:05 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:35:05 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Took 0.45 seconds to deallocate network for instance.
Jul 25 10:35:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-fe242255-6305-4d2f-a441-7d88b025a402 req-f16af115-2b68-43b0-a6f4-c5d4dc237158 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-deleted-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:35:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:35:05 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Deleted allocations for instance 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f
Jul 25 10:35:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-152654d2-a7e0-49bd-b5dc-ac53f7ce72b9 tempest-ServerRescueNegativeTestJSON-1328366493 tempest-ServerRescueNegativeTestJSON-1328366493-project-member] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.614s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:35:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-43715809-259a-4562-8613-ddabb65ea7dc req-dd1e8347-02e5-46af-98c2-d340b2c933d7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:35:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43715809-259a-4562-8613-ddabb65ea7dc req-dd1e8347-02e5-46af-98c2-d340b2c933d7 service nova] Acquiring lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:35:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43715809-259a-4562-8613-ddabb65ea7dc req-dd1e8347-02e5-46af-98c2-d340b2c933d7 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:35:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43715809-259a-4562-8613-ddabb65ea7dc req-dd1e8347-02e5-46af-98c2-d340b2c933d7 service nova] Lock "68165a49-f7f7-48b2-b7a0-34c09c6e8d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:35:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-43715809-259a-4562-8613-ddabb65ea7dc req-dd1e8347-02e5-46af-98c2-d340b2c933d7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] No waiting events found dispatching network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:35:06 user nova-compute[71312]: WARNING nova.compute.manager [req-43715809-259a-4562-8613-ddabb65ea7dc req-dd1e8347-02e5-46af-98c2-d340b2c933d7 service nova] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Received unexpected event network-vif-plugged-a2b2a233-ed89-4660-b554-fb9e3260c20f for instance with vm_state deleted and task_state None.
Jul 25 10:35:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-a3a7bbef-3a84-4cdf-9326-e52be53f1c8a req-fc9451c0-2928-4190-bd3d-46c7e698e130 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Received event network-changed-75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:35:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-a3a7bbef-3a84-4cdf-9326-e52be53f1c8a req-fc9451c0-2928-4190-bd3d-46c7e698e130 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Refreshing instance network info cache due to event network-changed-75337dc7-36f2-44d5-b3c0-5b749dda87a4. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:35:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a3a7bbef-3a84-4cdf-9326-e52be53f1c8a req-fc9451c0-2928-4190-bd3d-46c7e698e130 service nova] Acquiring lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:35:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a3a7bbef-3a84-4cdf-9326-e52be53f1c8a req-fc9451c0-2928-4190-bd3d-46c7e698e130 service nova] Acquired lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:35:10 user nova-compute[71312]: DEBUG nova.network.neutron [req-a3a7bbef-3a84-4cdf-9326-e52be53f1c8a req-fc9451c0-2928-4190-bd3d-46c7e698e130 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Refreshing network info cache for port 75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:35:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-a3a7bbef-3a84-4cdf-9326-e52be53f1c8a req-fc9451c0-2928-4190-bd3d-46c7e698e130 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Updated VIF entry in instance network info cache for port 75337dc7-36f2-44d5-b3c0-5b749dda87a4. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:35:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-a3a7bbef-3a84-4cdf-9326-e52be53f1c8a req-fc9451c0-2928-4190-bd3d-46c7e698e130 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Updating instance_info_cache with network_info: [{"id": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "address": "fa:16:3e:23:71:c9", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75337dc7-36", "ovs_interfaceid": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:35:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a3a7bbef-3a84-4cdf-9326-e52be53f1c8a req-fc9451c0-2928-4190-bd3d-46c7e698e130 service nova] Releasing lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:35:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:20 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690281305.0395365, 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:35:20 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] VM Stopped (Lifecycle Event)
Jul 25 10:35:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-36afe586-417b-444a-8143-515272ab1da6 None None] [instance: 68165a49-f7f7-48b2-b7a0-34c09c6e8d2f] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:35:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "5b065f50-7389-4000-967a-b30802c5c4c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:35:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "5b065f50-7389-4000-967a-b30802c5c4c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:35:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:35:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:35:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:35:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:35:21 user nova-compute[71312]: INFO nova.compute.claims [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Claim successful on node user
Jul 25 10:35:21 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:35:21 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:35:22 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:35:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:35:22 user nova-compute[71312]: INFO nova.virt.block_device [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Booting with volume 13f19bde-91e6-4e69-9f91-e7361c4efeee at /dev/vda
Jul 25 10:35:22 user nova-compute[71312]: DEBUG nova.policy [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b15229b8fb22457ca38b9c5bf2f6dbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55fc0544c744824b3b999ecfcf11e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG os_brick.utils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d00ad6-62a0-4841-bc07-0db7b47b0ace]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4e56096a058\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08a4954-1fa1-4164-8fb3-1ccbc6628aa8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd57edf8-f71c-4041-83ea-5574ccba19c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd719c0-420c-439f-8686-bfa2f16491bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 10:35:22 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 10:35:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ad066f-4446-401b-901d-0305eae4300d]: (4, '') {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG os_brick.utils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4e56096a058', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Updating existing volume attachment record: de00888b-1de9-4659-85fa-d92f54e2f106 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 10:35:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Successfully created port: cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:35:23 user nova-compute[71312]: DEBUG nova.network.neutron [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Successfully updated port: cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:35:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:35:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquired lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:35:23 user nova-compute[71312]: DEBUG nova.network.neutron [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:35:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-4b89bf96-f1ce-4a78-b3ed-9d1842ff2d23 req-18bb3818-09ec-423d-907c-7d32493b921a service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Received event network-changed-cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:35:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-4b89bf96-f1ce-4a78-b3ed-9d1842ff2d23 req-18bb3818-09ec-423d-907c-7d32493b921a service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Refreshing instance network info cache due to event network-changed-cdd1885c-f639-4e8d-985b-54fadc471b36. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:35:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4b89bf96-f1ce-4a78-b3ed-9d1842ff2d23 req-18bb3818-09ec-423d-907c-7d32493b921a service nova] Acquiring lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:35:23 user nova-compute[71312]: DEBUG nova.network.neutron [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:35:23 user nova-compute[71312]: DEBUG nova.network.neutron [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Updating instance_info_cache with network_info: [{"id": "cdd1885c-f639-4e8d-985b-54fadc471b36", "address": "fa:16:3e:d1:e9:da", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd1885c-f6", "ovs_interfaceid": "cdd1885c-f639-4e8d-985b-54fadc471b36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:35:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Releasing lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:35:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Instance network_info: |[{"id": "cdd1885c-f639-4e8d-985b-54fadc471b36", "address": "fa:16:3e:d1:e9:da", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd1885c-f6", "ovs_interfaceid": "cdd1885c-f639-4e8d-985b-54fadc471b36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:35:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4b89bf96-f1ce-4a78-b3ed-9d1842ff2d23 req-18bb3818-09ec-423d-907c-7d32493b921a service nova] Acquired lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:35:23 user nova-compute[71312]: DEBUG nova.network.neutron [req-4b89bf96-f1ce-4a78-b3ed-9d1842ff2d23 req-18bb3818-09ec-423d-907c-7d32493b921a service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Refreshing network info cache for port cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:35:24 user nova-compute[71312]: DEBUG nova.network.neutron [req-4b89bf96-f1ce-4a78-b3ed-9d1842ff2d23 req-18bb3818-09ec-423d-907c-7d32493b921a service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Updated VIF entry in instance network info cache for port cdd1885c-f639-4e8d-985b-54fadc471b36. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:35:24 user nova-compute[71312]: DEBUG nova.network.neutron [req-4b89bf96-f1ce-4a78-b3ed-9d1842ff2d23 req-18bb3818-09ec-423d-907c-7d32493b921a service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Updating instance_info_cache with network_info: [{"id": "cdd1885c-f639-4e8d-985b-54fadc471b36", "address": "fa:16:3e:d1:e9:da", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd1885c-f6", "ovs_interfaceid": "cdd1885c-f639-4e8d-985b-54fadc471b36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:35:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4b89bf96-f1ce-4a78-b3ed-9d1842ff2d23 req-18bb3818-09ec-423d-907c-7d32493b921a service nova] Releasing lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:35:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:35:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Creating image(s)
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Ensure instance console log exists: /opt/stack/data/nova/instances/5b065f50-7389-4000-967a-b30802c5c4c8/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Start _get_guest_xml network_info=[{"id": "cdd1885c-f639-4e8d-985b-54fadc471b36", "address": "fa:16:3e:d1:e9:da", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd1885c-f6", "ovs_interfaceid": "cdd1885c-f639-4e8d-985b-54fadc471b36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'de00888b-1de9-4659-85fa-d92f54e2f106', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LctYwZsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b065f50-7389-4000-967a-b30802c5c4c8', 'attached_at': '', 'detached_at': '', 'volume_id': '13f19bde-91e6-4e69-9f91-e7361c4efeee', 'serial': '13f19bde-91e6-4e69-9f91-e7361c4efeee'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:35:28 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:35:28 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LctYwZsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:35:28 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:35:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:35:28 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:35:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:35:28 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f5f2ec-11f4-440d-9ac2-b6718f925cf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 10:35:28 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --interface default --op new {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[961abf5f-1486-453e-869e-9e8152e97c64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee] added\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee] added
Jul 25 10:35:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5934f08-d54e-45dc-b7d6-d949a54b3bf1]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb27cfb4-97ab-459b-b714-6c922297033b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LctYwZsl {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LctYwZsl" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63fc2f6-03f4-459a-913b-734b68226dc7]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LctYwZsl'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6539f0-96ea-4d82-b697-ac62388e573b]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a5df92-085e-4fa7-acda-e7390c652f69]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:35:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:35:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --login {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e334bf4a-4aeb-43e3-a453-a590e0bb5b96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee, portal: 172.16.0.220,3260]
Jul 25 10:35:29 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee, portal: 172.16.0.220,3260] successful.
Jul 25 10:35:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7e12f3-dd11-477d-876e-14ba2ceb1e61]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cbf018-a6c9-46e6-baa7-f7a561d89376]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:35:29 user nova-compute[71312]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee (non-flash)
Jul 25 10:35:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:35:29 user nova-compute[71312]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee (non-flash)
Jul 25 10:35:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aa68b1-cf57-407c-b7cf-325e815cc478]: (4, ('- - 0', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 10:35:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LctYwZsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23236663763653334', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236663763653334', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:35:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-500043683',display_name='tempest-TestVolumeBootPattern-server-500043683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-500043683',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ58gOY1gpOMvj/EiDsxdOjUfY11OGPSuA+GqxT7AzdzB8RcuiyhMOzL2fb60k7qwq0j7GQDzCRx0/Eh2wLjaML4Hb7FzYQTNf3zkUR2LuJI3IlnbZbMees+kYGZ2MIH6Q==',key_name='tempest-TestVolumeBootPattern-1416605656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-98bknw2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:35:22Z,user_data=None,user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=5b065f50-7389-4000-967a-b30802c5c4c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdd1885c-f639-4e8d-985b-54fadc471b36", "address": "fa:16:3e:d1:e9:da", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd1885c-f6", "ovs_interfaceid": "cdd1885c-f639-4e8d-985b-54fadc471b36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "cdd1885c-f639-4e8d-985b-54fadc471b36", "address": "fa:16:3e:d1:e9:da", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd1885c-f6", "ovs_interfaceid": "cdd1885c-f639-4e8d-985b-54fadc471b36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e9:da,bridge_name='br-int',has_traffic_filtering=True,id=cdd1885c-f639-4e8d-985b-54fadc471b36,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd1885c-f6') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b065f50-7389-4000-967a-b30802c5c4c8 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:35:30 user nova-compute[71312]:   <uuid>5b065f50-7389-4000-967a-b30802c5c4c8</uuid>
Jul 25 10:35:30 user nova-compute[71312]:   <name>instance-00000032</name>
Jul 25 10:35:30 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:35:30 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:35:30 user nova-compute[71312]:   <metadata>
Jul 25 10:35:30 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:35:30 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:35:30 user nova-compute[71312]:       <nova:name>tempest-TestVolumeBootPattern-server-500043683</nova:name>
Jul 25 10:35:30 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:35:28</nova:creationTime>
Jul 25 10:35:30 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:35:30 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:35:30 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:35:30 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:35:30 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:35:30 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:35:30 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:35:30 user nova-compute[71312]:       <nova:owner>
Jul 25 10:35:30 user nova-compute[71312]:         <nova:user uuid="b15229b8fb22457ca38b9c5bf2f6dbc3">tempest-TestVolumeBootPattern-614700428-project-member</nova:user>
Jul 25 10:35:30 user nova-compute[71312]:         <nova:project uuid="e55fc0544c744824b3b999ecfcf11e31">tempest-TestVolumeBootPattern-614700428</nova:project>
Jul 25 10:35:30 user nova-compute[71312]:       </nova:owner>
Jul 25 10:35:30 user nova-compute[71312]:       <nova:ports>
Jul 25 10:35:30 user nova-compute[71312]:         <nova:port uuid="cdd1885c-f639-4e8d-985b-54fadc471b36">
Jul 25 10:35:30 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 10:35:30 user nova-compute[71312]:         </nova:port>
Jul 25 10:35:30 user nova-compute[71312]:       </nova:ports>
Jul 25 10:35:30 user nova-compute[71312]:     </nova:instance>
Jul 25 10:35:30 user nova-compute[71312]:   </metadata>
Jul 25 10:35:30 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:35:30 user nova-compute[71312]:     <system>
Jul 25 10:35:30 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:35:30 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:35:30 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:35:30 user nova-compute[71312]:       <entry name="serial">5b065f50-7389-4000-967a-b30802c5c4c8</entry>
Jul 25 10:35:30 user nova-compute[71312]:       <entry name="uuid">5b065f50-7389-4000-967a-b30802c5c4c8</entry>
Jul 25 10:35:30 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:35:30 user nova-compute[71312]:     </system>
Jul 25 10:35:30 user nova-compute[71312]:   </sysinfo>
Jul 25 10:35:30 user nova-compute[71312]:   <os>
Jul 25 10:35:30 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:35:30 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:35:30 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:35:30 user nova-compute[71312]:   </os>
Jul 25 10:35:30 user nova-compute[71312]:   <features>
Jul 25 10:35:30 user nova-compute[71312]:     <acpi/>
Jul 25 10:35:30 user nova-compute[71312]:     <apic/>
Jul 25 10:35:30 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:35:30 user nova-compute[71312]:   </features>
Jul 25 10:35:30 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:35:30 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:35:30 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:35:30 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:35:30 user nova-compute[71312]:   </clock>
Jul 25 10:35:30 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:35:30 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:35:30 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:35:30 user nova-compute[71312]:   </cpu>
Jul 25 10:35:30 user nova-compute[71312]:   <devices>
Jul 25 10:35:30 user nova-compute[71312]:     <disk type="block" device="disk">
Jul 25 10:35:30 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 10:35:30 user nova-compute[71312]:       <source dev="/dev/sdc"/>
Jul 25 10:35:30 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:35:30 user nova-compute[71312]:       <serial>13f19bde-91e6-4e69-9f91-e7361c4efeee</serial>
Jul 25 10:35:30 user nova-compute[71312]:     </disk>
Jul 25 10:35:30 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:35:30 user nova-compute[71312]:       <mac address="fa:16:3e:d1:e9:da"/>
Jul 25 10:35:30 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:35:30 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:35:30 user nova-compute[71312]:       <target dev="tapcdd1885c-f6"/>
Jul 25 10:35:30 user nova-compute[71312]:     </interface>
Jul 25 10:35:30 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:35:30 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/5b065f50-7389-4000-967a-b30802c5c4c8/console.log" append="off"/>
Jul 25 10:35:30 user nova-compute[71312]:     </serial>
Jul 25 10:35:30 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:35:30 user nova-compute[71312]:     <video>
Jul 25 10:35:30 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:35:30 user nova-compute[71312]:     </video>
Jul 25 10:35:30 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:35:30 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:35:30 user nova-compute[71312]:     </rng>
Jul 25 10:35:30 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:35:30 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:35:30 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:35:30 user nova-compute[71312]:     </memballoon>
Jul 25 10:35:30 user nova-compute[71312]:   </devices>
Jul 25 10:35:30 user nova-compute[71312]: </domain>
Jul 25 10:35:30 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:35:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-500043683',display_name='tempest-TestVolumeBootPattern-server-500043683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-500043683',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ58gOY1gpOMvj/EiDsxdOjUfY11OGPSuA+GqxT7AzdzB8RcuiyhMOzL2fb60k7qwq0j7GQDzCRx0/Eh2wLjaML4Hb7FzYQTNf3zkUR2LuJI3IlnbZbMees+kYGZ2MIH6Q==',key_name='tempest-TestVolumeBootPattern-1416605656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-98bknw2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:35:22Z,user_data=None,user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=5b065f50-7389-4000-967a-b30802c5c4c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdd1885c-f639-4e8d-985b-54fadc471b36", "address": "fa:16:3e:d1:e9:da", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd1885c-f6", "ovs_interfaceid": "cdd1885c-f639-4e8d-985b-54fadc471b36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "cdd1885c-f639-4e8d-985b-54fadc471b36", "address": "fa:16:3e:d1:e9:da", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd1885c-f6", "ovs_interfaceid": "cdd1885c-f639-4e8d-985b-54fadc471b36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e9:da,bridge_name='br-int',has_traffic_filtering=True,id=cdd1885c-f639-4e8d-985b-54fadc471b36,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd1885c-f6') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG os_vif [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e9:da,bridge_name='br-int',has_traffic_filtering=True,id=cdd1885c-f639-4e8d-985b-54fadc471b36,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd1885c-f6') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdd1885c-f6, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcdd1885c-f6, col_values=(('external_ids', {'iface-id': 'cdd1885c-f639-4e8d-985b-54fadc471b36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:e9:da', 'vm-uuid': '5b065f50-7389-4000-967a-b30802c5c4c8'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:30 user nova-compute[71312]: INFO os_vif [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e9:da,bridge_name='br-int',has_traffic_filtering=True,id=cdd1885c-f639-4e8d-985b-54fadc471b36,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd1885c-f6')
Jul 25 10:35:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:35:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] No VIF found with MAC fa:16:3e:d1:e9:da, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:35:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-a45bdbdb-f8f9-4dc4-8286-a27e7f1a41a8 req-13296ffc-d2eb-4249-95d9-3eeec2628a3d service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Received event network-vif-plugged-cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:35:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a45bdbdb-f8f9-4dc4-8286-a27e7f1a41a8 req-13296ffc-d2eb-4249-95d9-3eeec2628a3d service nova] Acquiring lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:35:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a45bdbdb-f8f9-4dc4-8286-a27e7f1a41a8 req-13296ffc-d2eb-4249-95d9-3eeec2628a3d service nova] Lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:35:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a45bdbdb-f8f9-4dc4-8286-a27e7f1a41a8 req-13296ffc-d2eb-4249-95d9-3eeec2628a3d service nova] Lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:35:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-a45bdbdb-f8f9-4dc4-8286-a27e7f1a41a8 req-13296ffc-d2eb-4249-95d9-3eeec2628a3d service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] No waiting events found dispatching network-vif-plugged-cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:35:31 user nova-compute[71312]: WARNING nova.compute.manager [req-a45bdbdb-f8f9-4dc4-8286-a27e7f1a41a8 req-13296ffc-d2eb-4249-95d9-3eeec2628a3d service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Received unexpected event network-vif-plugged-cdd1885c-f639-4e8d-985b-54fadc471b36 for instance with vm_state building and task_state spawning.
Jul 25 10:35:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690281333.5148892, 5b065f50-7389-4000-967a-b30802c5c4c8 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:35:33 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] VM Resumed (Lifecycle Event)
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:35:33 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Instance spawned successfully.
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:35:33 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690281333.5162058, 5b065f50-7389-4000-967a-b30802c5c4c8 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:35:33 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] VM Started (Lifecycle Event)
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:35:33 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:35:33 user nova-compute[71312]: INFO nova.compute.manager [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Took 4.84 seconds to spawn the instance on the hypervisor.
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-d8322177-827d-431b-8aef-dcd47b6b8071 req-9fc84152-f6ff-459b-a693-4c099f16cc98 service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Received event network-vif-plugged-cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d8322177-827d-431b-8aef-dcd47b6b8071 req-9fc84152-f6ff-459b-a693-4c099f16cc98 service nova] Acquiring lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d8322177-827d-431b-8aef-dcd47b6b8071 req-9fc84152-f6ff-459b-a693-4c099f16cc98 service nova] Lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d8322177-827d-431b-8aef-dcd47b6b8071 req-9fc84152-f6ff-459b-a693-4c099f16cc98 service nova] Lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:35:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-d8322177-827d-431b-8aef-dcd47b6b8071 req-9fc84152-f6ff-459b-a693-4c099f16cc98 service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] No waiting events found dispatching network-vif-plugged-cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:35:33 user nova-compute[71312]: WARNING nova.compute.manager [req-d8322177-827d-431b-8aef-dcd47b6b8071 req-9fc84152-f6ff-459b-a693-4c099f16cc98 service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Received unexpected event network-vif-plugged-cdd1885c-f639-4e8d-985b-54fadc471b36 for instance with vm_state building and task_state spawning.
Jul 25 10:35:33 user nova-compute[71312]: INFO nova.compute.manager [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Took 11.93 seconds to build instance.
Jul 25 10:35:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4abdd99b-6a22-4590-ae06-912acb9bbe6d tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "5b065f50-7389-4000-967a-b30802c5c4c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.030s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:35:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:35:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:35:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 10:35:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:35:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:35:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:35:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lazy-loading 'info_cache' on Instance uuid 46d26d26-23b4-4a9c-ae16-63dda292a3ed {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:35:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Updating instance_info_cache with network_info: [{"id": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "address": "fa:16:3e:23:71:c9", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75337dc7-36", "ovs_interfaceid": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:35:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:35:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:35:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:35:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:35:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:35:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:35:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:35:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:35:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:35:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:35:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:35:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:35:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:35:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:35:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:35:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:35:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:35:53 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:35:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:35:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:35:54 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:35:54 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:35:54 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8625MB free_disk=25.189796447753906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:35:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:35:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:35:54 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 46d26d26-23b4-4a9c-ae16-63dda292a3ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:35:54 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5b065f50-7389-4000-967a-b30802c5c4c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:35:54 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:35:54 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:35:54 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:35:54 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:35:54 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:35:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:35:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:35:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:35:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:36:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:36:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:36:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:36:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:36:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:36:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:36:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:36:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Verify base images {{(pid=71312) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 25 10:36:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71312) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 25 10:36:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] 5b065f50-7389-4000-967a-b30802c5c4c8 is a valid instance name {{(pid=71312) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 25 10:36:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] 46d26d26-23b4-4a9c-ae16-63dda292a3ed is a valid instance name {{(pid=71312) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 25 10:36:09 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Unknown base file: /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0
Jul 25 10:36:09 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Unknown base file: /opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168
Jul 25 10:36:09 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Unknown base file: /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62
Jul 25 10:36:09 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Unknown base file: /opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4
Jul 25 10:36:09 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Unknown base file: /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82
Jul 25 10:36:09 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Unknown base file: /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd
Jul 25 10:36:09 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Unknown base file: /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3
Jul 25 10:36:09 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Unknown base file: /opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700
Jul 25 10:36:09 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Unknown base file: /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999
Jul 25 10:36:09 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Unknown base file: /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279
Jul 25 10:36:09 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Removable base files: /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0 /opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168 /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 /opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4 /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82 /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3 /opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700 /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999 /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279
Jul 25 10:36:09 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5aef01b17120e8d68e8fe7895dd24d9b1776ddf0
Jul 25 10:36:09 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/73e7126e6fbd6d5ddba8dd839b823334ea8ef168
Jul 25 10:36:09 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62
Jul 25 10:36:09 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ca00f4eddd7943a2c3c8a45c213bda8c37f3d8d4
Jul 25 10:36:09 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5b816a569a10b167bc31bafc4d2824e7dd68ee82
Jul 25 10:36:09 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/030f187535f4ed94820ab44862fd34086c0705dd
Jul 25 10:36:09 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/50a43aec5e393f7cc4e7371e2b4ad6b944cb75a3
Jul 25 10:36:09 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/65fa9c11aab58af54df6e36df9d168d6ce6e4700
Jul 25 10:36:09 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/17cc90b74add940c5ba4cfebba463c16b482d999
Jul 25 10:36:09 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/72e6d375d93848b5720902266edd99508a303279
Jul 25 10:36:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Verification complete {{(pid=71312) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 25 10:36:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Verify swap images {{(pid=71312) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 25 10:36:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Verify ephemeral images {{(pid=71312) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 25 10:36:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:36:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:36:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:36:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:36:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:36:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:36:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:36:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:36:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:36:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Updating instance_info_cache with network_info: [{"id": "cdd1885c-f639-4e8d-985b-54fadc471b36", "address": "fa:16:3e:d1:e9:da", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd1885c-f6", "ovs_interfaceid": "cdd1885c-f639-4e8d-985b-54fadc471b36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:36:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:36:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:36:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:36:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Acquiring lock "000f4177-aa96-4868-84e2-9e39520bc9e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:36:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:36:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 10:36:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:36:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:36:44 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 10:36:44 user nova-compute[71312]: INFO nova.compute.claims [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Claim successful on node user
Jul 25 10:36:44 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:36:44 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:36:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:36:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 10:36:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 10:36:44 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 10:36:44 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 10:36:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG nova.policy [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '196ca753f75448f3a0a17e06f09819f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4505d39249a44a88e618bd3d909d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 10:36:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Creating image(s)
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Acquiring lock "/opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "/opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "/opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Acquiring lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62,backing_fmt=raw /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk 1073741824" returned: 0 in 0.055s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "e3c512f7285c20f18142ec0714af153a8fcdfa62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3c512f7285c20f18142ec0714af153a8fcdfa62 --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Checking if we can resize image /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Successfully created port: 377b85e7-2bc7-43cc-9971-b739d962135c {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Cannot resize image /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lazy-loading 'migration_context' on Instance uuid 000f4177-aa96-4868-84e2-9e39520bc9e7 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Ensure instance console log exists: /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:36:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:36:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Successfully updated port: 377b85e7-2bc7-43cc-9971-b739d962135c {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 10:36:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Acquiring lock "refresh_cache-000f4177-aa96-4868-84e2-9e39520bc9e7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:36:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Acquired lock "refresh_cache-000f4177-aa96-4868-84e2-9e39520bc9e7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:36:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 10:36:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-c6383283-b47d-46ae-9956-4f0e6f53c2f8 req-e626cd12-6659-41e7-a92c-fa5dba5254c3 service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Received event network-changed-377b85e7-2bc7-43cc-9971-b739d962135c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:36:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-c6383283-b47d-46ae-9956-4f0e6f53c2f8 req-e626cd12-6659-41e7-a92c-fa5dba5254c3 service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Refreshing instance network info cache due to event network-changed-377b85e7-2bc7-43cc-9971-b739d962135c. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:36:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c6383283-b47d-46ae-9956-4f0e6f53c2f8 req-e626cd12-6659-41e7-a92c-fa5dba5254c3 service nova] Acquiring lock "refresh_cache-000f4177-aa96-4868-84e2-9e39520bc9e7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:36:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Updating instance_info_cache with network_info: [{"id": "377b85e7-2bc7-43cc-9971-b739d962135c", "address": "fa:16:3e:7f:f6:35", "network": {"id": "db79f9f9-66e6-4b16-9508-545925384510", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2072222984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4505d39249a44a88e618bd3d909d74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377b85e7-2b", "ovs_interfaceid": "377b85e7-2bc7-43cc-9971-b739d962135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Releasing lock "refresh_cache-000f4177-aa96-4868-84e2-9e39520bc9e7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Instance network_info: |[{"id": "377b85e7-2bc7-43cc-9971-b739d962135c", "address": "fa:16:3e:7f:f6:35", "network": {"id": "db79f9f9-66e6-4b16-9508-545925384510", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2072222984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4505d39249a44a88e618bd3d909d74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377b85e7-2b", "ovs_interfaceid": "377b85e7-2bc7-43cc-9971-b739d962135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c6383283-b47d-46ae-9956-4f0e6f53c2f8 req-e626cd12-6659-41e7-a92c-fa5dba5254c3 service nova] Acquired lock "refresh_cache-000f4177-aa96-4868-84e2-9e39520bc9e7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-c6383283-b47d-46ae-9956-4f0e6f53c2f8 req-e626cd12-6659-41e7-a92c-fa5dba5254c3 service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Refreshing network info cache for port 377b85e7-2bc7-43cc-9971-b739d962135c {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Start _get_guest_xml network_info=[{"id": "377b85e7-2bc7-43cc-9971-b739d962135c", "address": "fa:16:3e:7f:f6:35", "network": {"id": "db79f9f9-66e6-4b16-9508-545925384510", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2072222984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4505d39249a44a88e618bd3d909d74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377b85e7-2b", "ovs_interfaceid": "377b85e7-2bc7-43cc-9971-b739d962135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 10:36:47 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:36:47 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] CPU controller missing on host. {{(pid=71312) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] CPU controller found on host. {{(pid=71312) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T09:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T09:56:38Z,direct_url=<?>,disk_format='qcow2',id=ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4c23af42fc11471fb11ccf88d9e96d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T09:56:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-399673293',display_name='tempest-VolumesActionsTest-instance-399673293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-399673293',id=51,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4505d39249a44a88e618bd3d909d74b',ramdisk_id='',reservation_id='r-6d056gpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1385404890',owner_user_name='tempest-VolumesActionsTest-1385404890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:36:45Z,user_data=None,user_id='196ca753f75448f3a0a17e06f09819f4',uuid=000f4177-aa96-4868-84e2-9e39520bc9e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "377b85e7-2bc7-43cc-9971-b739d962135c", "address": "fa:16:3e:7f:f6:35", "network": {"id": "db79f9f9-66e6-4b16-9508-545925384510", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2072222984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4505d39249a44a88e618bd3d909d74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377b85e7-2b", "ovs_interfaceid": "377b85e7-2bc7-43cc-9971-b739d962135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Converting VIF {"id": "377b85e7-2bc7-43cc-9971-b739d962135c", "address": "fa:16:3e:7f:f6:35", "network": {"id": "db79f9f9-66e6-4b16-9508-545925384510", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2072222984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4505d39249a44a88e618bd3d909d74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377b85e7-2b", "ovs_interfaceid": "377b85e7-2bc7-43cc-9971-b739d962135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f6:35,bridge_name='br-int',has_traffic_filtering=True,id=377b85e7-2bc7-43cc-9971-b739d962135c,network=Network(db79f9f9-66e6-4b16-9508-545925384510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377b85e7-2b') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lazy-loading 'pci_devices' on Instance uuid 000f4177-aa96-4868-84e2-9e39520bc9e7 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] End _get_guest_xml xml=<domain type="kvm">
Jul 25 10:36:47 user nova-compute[71312]:   <uuid>000f4177-aa96-4868-84e2-9e39520bc9e7</uuid>
Jul 25 10:36:47 user nova-compute[71312]:   <name>instance-00000033</name>
Jul 25 10:36:47 user nova-compute[71312]:   <memory>524288</memory>
Jul 25 10:36:47 user nova-compute[71312]:   <vcpu>1</vcpu>
Jul 25 10:36:47 user nova-compute[71312]:   <metadata>
Jul 25 10:36:47 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 10:36:47 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Jul 25 10:36:47 user nova-compute[71312]:       <nova:name>tempest-VolumesActionsTest-instance-399673293</nova:name>
Jul 25 10:36:47 user nova-compute[71312]:       <nova:creationTime>2023-07-25 10:36:47</nova:creationTime>
Jul 25 10:36:47 user nova-compute[71312]:       <nova:flavor name="m1.tiny">
Jul 25 10:36:47 user nova-compute[71312]:         <nova:memory>512</nova:memory>
Jul 25 10:36:47 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Jul 25 10:36:47 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Jul 25 10:36:47 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 10:36:47 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Jul 25 10:36:47 user nova-compute[71312]:       </nova:flavor>
Jul 25 10:36:47 user nova-compute[71312]:       <nova:owner>
Jul 25 10:36:47 user nova-compute[71312]:         <nova:user uuid="196ca753f75448f3a0a17e06f09819f4">tempest-VolumesActionsTest-1385404890-project-member</nova:user>
Jul 25 10:36:47 user nova-compute[71312]:         <nova:project uuid="e4505d39249a44a88e618bd3d909d74b">tempest-VolumesActionsTest-1385404890</nova:project>
Jul 25 10:36:47 user nova-compute[71312]:       </nova:owner>
Jul 25 10:36:47 user nova-compute[71312]:       <nova:root type="image" uuid="ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8"/>
Jul 25 10:36:47 user nova-compute[71312]:       <nova:ports>
Jul 25 10:36:47 user nova-compute[71312]:         <nova:port uuid="377b85e7-2bc7-43cc-9971-b739d962135c">
Jul 25 10:36:47 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 25 10:36:47 user nova-compute[71312]:         </nova:port>
Jul 25 10:36:47 user nova-compute[71312]:       </nova:ports>
Jul 25 10:36:47 user nova-compute[71312]:     </nova:instance>
Jul 25 10:36:47 user nova-compute[71312]:   </metadata>
Jul 25 10:36:47 user nova-compute[71312]:   <sysinfo type="smbios">
Jul 25 10:36:47 user nova-compute[71312]:     <system>
Jul 25 10:36:47 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 10:36:47 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Jul 25 10:36:47 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Jul 25 10:36:47 user nova-compute[71312]:       <entry name="serial">000f4177-aa96-4868-84e2-9e39520bc9e7</entry>
Jul 25 10:36:47 user nova-compute[71312]:       <entry name="uuid">000f4177-aa96-4868-84e2-9e39520bc9e7</entry>
Jul 25 10:36:47 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Jul 25 10:36:47 user nova-compute[71312]:     </system>
Jul 25 10:36:47 user nova-compute[71312]:   </sysinfo>
Jul 25 10:36:47 user nova-compute[71312]:   <os>
Jul 25 10:36:47 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 10:36:47 user nova-compute[71312]:     <boot dev="hd"/>
Jul 25 10:36:47 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Jul 25 10:36:47 user nova-compute[71312]:   </os>
Jul 25 10:36:47 user nova-compute[71312]:   <features>
Jul 25 10:36:47 user nova-compute[71312]:     <acpi/>
Jul 25 10:36:47 user nova-compute[71312]:     <apic/>
Jul 25 10:36:47 user nova-compute[71312]:     <vmcoreinfo/>
Jul 25 10:36:47 user nova-compute[71312]:   </features>
Jul 25 10:36:47 user nova-compute[71312]:   <clock offset="utc">
Jul 25 10:36:47 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 10:36:47 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 10:36:47 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Jul 25 10:36:47 user nova-compute[71312]:   </clock>
Jul 25 10:36:47 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Jul 25 10:36:47 user nova-compute[71312]:     <model>Nehalem</model>
Jul 25 10:36:47 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 10:36:47 user nova-compute[71312]:   </cpu>
Jul 25 10:36:47 user nova-compute[71312]:   <devices>
Jul 25 10:36:47 user nova-compute[71312]:     <disk type="file" device="disk">
Jul 25 10:36:47 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 10:36:47 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk"/>
Jul 25 10:36:47 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Jul 25 10:36:47 user nova-compute[71312]:     </disk>
Jul 25 10:36:47 user nova-compute[71312]:     <interface type="ethernet">
Jul 25 10:36:47 user nova-compute[71312]:       <mac address="fa:16:3e:7f:f6:35"/>
Jul 25 10:36:47 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:36:47 user nova-compute[71312]:       <mtu size="1442"/>
Jul 25 10:36:47 user nova-compute[71312]:       <target dev="tap377b85e7-2b"/>
Jul 25 10:36:47 user nova-compute[71312]:     </interface>
Jul 25 10:36:47 user nova-compute[71312]:     <serial type="pty">
Jul 25 10:36:47 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/console.log" append="off"/>
Jul 25 10:36:47 user nova-compute[71312]:     </serial>
Jul 25 10:36:47 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 10:36:47 user nova-compute[71312]:     <video>
Jul 25 10:36:47 user nova-compute[71312]:       <model type="virtio"/>
Jul 25 10:36:47 user nova-compute[71312]:     </video>
Jul 25 10:36:47 user nova-compute[71312]:     <rng model="virtio">
Jul 25 10:36:47 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Jul 25 10:36:47 user nova-compute[71312]:     </rng>
Jul 25 10:36:47 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Jul 25 10:36:47 user nova-compute[71312]:     <memballoon model="virtio">
Jul 25 10:36:47 user nova-compute[71312]:       <stats period="10"/>
Jul 25 10:36:47 user nova-compute[71312]:     </memballoon>
Jul 25 10:36:47 user nova-compute[71312]:   </devices>
Jul 25 10:36:47 user nova-compute[71312]: </domain>
Jul 25 10:36:47 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-399673293',display_name='tempest-VolumesActionsTest-instance-399673293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-399673293',id=51,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4505d39249a44a88e618bd3d909d74b',ramdisk_id='',reservation_id='r-6d056gpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1385404890',owner_user_name='tempest-VolumesActionsTest-1385404890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T10:36:45Z,user_data=None,user_id='196ca753f75448f3a0a17e06f09819f4',uuid=000f4177-aa96-4868-84e2-9e39520bc9e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "377b85e7-2bc7-43cc-9971-b739d962135c", "address": "fa:16:3e:7f:f6:35", "network": {"id": "db79f9f9-66e6-4b16-9508-545925384510", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2072222984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4505d39249a44a88e618bd3d909d74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377b85e7-2b", "ovs_interfaceid": "377b85e7-2bc7-43cc-9971-b739d962135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Converting VIF {"id": "377b85e7-2bc7-43cc-9971-b739d962135c", "address": "fa:16:3e:7f:f6:35", "network": {"id": "db79f9f9-66e6-4b16-9508-545925384510", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2072222984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4505d39249a44a88e618bd3d909d74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377b85e7-2b", "ovs_interfaceid": "377b85e7-2bc7-43cc-9971-b739d962135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f6:35,bridge_name='br-int',has_traffic_filtering=True,id=377b85e7-2bc7-43cc-9971-b739d962135c,network=Network(db79f9f9-66e6-4b16-9508-545925384510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377b85e7-2b') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG os_vif [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f6:35,bridge_name='br-int',has_traffic_filtering=True,id=377b85e7-2bc7-43cc-9971-b739d962135c,network=Network(db79f9f9-66e6-4b16-9508-545925384510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377b85e7-2b') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap377b85e7-2b, may_exist=True, interface_attrs={}) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap377b85e7-2b, col_values=(('external_ids', {'iface-id': '377b85e7-2bc7-43cc-9971-b739d962135c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:f6:35', 'vm-uuid': '000f4177-aa96-4868-84e2-9e39520bc9e7'}),), if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:47 user nova-compute[71312]: INFO os_vif [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f6:35,bridge_name='br-int',has_traffic_filtering=True,id=377b85e7-2bc7-43cc-9971-b739d962135c,network=Network(db79f9f9-66e6-4b16-9508-545925384510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377b85e7-2b')
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] No VIF found with MAC fa:16:3e:7f:f6:35, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-c6383283-b47d-46ae-9956-4f0e6f53c2f8 req-e626cd12-6659-41e7-a92c-fa5dba5254c3 service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Updated VIF entry in instance network info cache for port 377b85e7-2bc7-43cc-9971-b739d962135c. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-c6383283-b47d-46ae-9956-4f0e6f53c2f8 req-e626cd12-6659-41e7-a92c-fa5dba5254c3 service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Updating instance_info_cache with network_info: [{"id": "377b85e7-2bc7-43cc-9971-b739d962135c", "address": "fa:16:3e:7f:f6:35", "network": {"id": "db79f9f9-66e6-4b16-9508-545925384510", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2072222984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4505d39249a44a88e618bd3d909d74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377b85e7-2b", "ovs_interfaceid": "377b85e7-2bc7-43cc-9971-b739d962135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c6383283-b47d-46ae-9956-4f0e6f53c2f8 req-e626cd12-6659-41e7-a92c-fa5dba5254c3 service nova] Releasing lock "refresh_cache-000f4177-aa96-4868-84e2-9e39520bc9e7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:36:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:36:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-3af0ee69-cfd5-4d18-8995-fa09e3202b14 req-b5f1ff70-dbd8-424b-b597-ca385c766f2c service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Received event network-vif-plugged-377b85e7-2bc7-43cc-9971-b739d962135c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:36:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3af0ee69-cfd5-4d18-8995-fa09e3202b14 req-b5f1ff70-dbd8-424b-b597-ca385c766f2c service nova] Acquiring lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:36:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3af0ee69-cfd5-4d18-8995-fa09e3202b14 req-b5f1ff70-dbd8-424b-b597-ca385c766f2c service nova] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:36:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3af0ee69-cfd5-4d18-8995-fa09e3202b14 req-b5f1ff70-dbd8-424b-b597-ca385c766f2c service nova] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:36:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-3af0ee69-cfd5-4d18-8995-fa09e3202b14 req-b5f1ff70-dbd8-424b-b597-ca385c766f2c service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] No waiting events found dispatching network-vif-plugged-377b85e7-2bc7-43cc-9971-b739d962135c {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:36:48 user nova-compute[71312]: WARNING nova.compute.manager [req-3af0ee69-cfd5-4d18-8995-fa09e3202b14 req-b5f1ff70-dbd8-424b-b597-ca385c766f2c service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Received unexpected event network-vif-plugged-377b85e7-2bc7-43cc-9971-b739d962135c for instance with vm_state building and task_state spawning.
Jul 25 10:36:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:36:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 10:36:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690281410.5699525, 000f4177-aa96-4868-84e2-9e39520bc9e7 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:36:50 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] VM Resumed (Lifecycle Event)
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 10:36:50 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Instance spawned successfully.
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 10:36:50 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.virt.driver [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] Emitting event <LifecycleEvent: 1690281410.57108, 000f4177-aa96-4868-84e2-9e39520bc9e7 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:36:50 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] VM Started (Lifecycle Event)
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 10:36:50 user nova-compute[71312]: INFO nova.compute.manager [None req-ef8c4845-b5c5-4ebd-b111-95724f7356b2 None None] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 10:36:50 user nova-compute[71312]: INFO nova.compute.manager [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Took 5.59 seconds to spawn the instance on the hypervisor.
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:36:50 user nova-compute[71312]: INFO nova.compute.manager [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Took 6.09 seconds to build instance.
Jul 25 10:36:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8b4bca47-3d19-4f73-ade5-9b01452b85a4 tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.190s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-049bb47f-ecb1-4b8e-8cf4-d1199accdcaa req-84708e8f-dfe1-43c5-9786-26ca7f721dac service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Received event network-vif-plugged-377b85e7-2bc7-43cc-9971-b739d962135c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-049bb47f-ecb1-4b8e-8cf4-d1199accdcaa req-84708e8f-dfe1-43c5-9786-26ca7f721dac service nova] Acquiring lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-049bb47f-ecb1-4b8e-8cf4-d1199accdcaa req-84708e8f-dfe1-43c5-9786-26ca7f721dac service nova] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-049bb47f-ecb1-4b8e-8cf4-d1199accdcaa req-84708e8f-dfe1-43c5-9786-26ca7f721dac service nova] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-049bb47f-ecb1-4b8e-8cf4-d1199accdcaa req-84708e8f-dfe1-43c5-9786-26ca7f721dac service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] No waiting events found dispatching network-vif-plugged-377b85e7-2bc7-43cc-9971-b739d962135c {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:36:50 user nova-compute[71312]: WARNING nova.compute.manager [req-049bb47f-ecb1-4b8e-8cf4-d1199accdcaa req-84708e8f-dfe1-43c5-9786-26ca7f721dac service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Received unexpected event network-vif-plugged-377b85e7-2bc7-43cc-9971-b739d962135c for instance with vm_state active and task_state None.
Jul 25 10:36:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:36:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:36:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:52 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:36:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:36:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:36:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:36:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:36:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:36:54 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:55 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:36:55 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:36:55 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8614MB free_disk=25.185359954833984GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 46d26d26-23b4-4a9c-ae16-63dda292a3ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 5b065f50-7389-4000-967a-b30802c5c4c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 000f4177-aa96-4868-84e2-9e39520bc9e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing inventories for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Updating ProviderTree inventory for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Updating inventory in ProviderTree for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 10:36:55 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing aggregate associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 10:36:56 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Refreshing trait associations for resource provider c43d9a23-2919-4969-9b66-f1d29eb9e809, traits: COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 10:36:56 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:36:56 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:36:56 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:36:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:36:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:36:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:36:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:36:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:36:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 10:37:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:01 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:37:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-33d90a06-d5c4-4ed9-ab6d-0e2fa8cd8c65 req-0aca276d-c6c9-4ab2-abeb-0be491ce43ae service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Received event network-changed-cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:37:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-33d90a06-d5c4-4ed9-ab6d-0e2fa8cd8c65 req-0aca276d-c6c9-4ab2-abeb-0be491ce43ae service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Refreshing instance network info cache due to event network-changed-cdd1885c-f639-4e8d-985b-54fadc471b36. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:37:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-33d90a06-d5c4-4ed9-ab6d-0e2fa8cd8c65 req-0aca276d-c6c9-4ab2-abeb-0be491ce43ae service nova] Acquiring lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:37:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-33d90a06-d5c4-4ed9-ab6d-0e2fa8cd8c65 req-0aca276d-c6c9-4ab2-abeb-0be491ce43ae service nova] Acquired lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:37:13 user nova-compute[71312]: DEBUG nova.network.neutron [req-33d90a06-d5c4-4ed9-ab6d-0e2fa8cd8c65 req-0aca276d-c6c9-4ab2-abeb-0be491ce43ae service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Refreshing network info cache for port cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:37:14 user nova-compute[71312]: DEBUG nova.network.neutron [req-33d90a06-d5c4-4ed9-ab6d-0e2fa8cd8c65 req-0aca276d-c6c9-4ab2-abeb-0be491ce43ae service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Updated VIF entry in instance network info cache for port cdd1885c-f639-4e8d-985b-54fadc471b36. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:37:14 user nova-compute[71312]: DEBUG nova.network.neutron [req-33d90a06-d5c4-4ed9-ab6d-0e2fa8cd8c65 req-0aca276d-c6c9-4ab2-abeb-0be491ce43ae service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Updating instance_info_cache with network_info: [{"id": "cdd1885c-f639-4e8d-985b-54fadc471b36", "address": "fa:16:3e:d1:e9:da", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd1885c-f6", "ovs_interfaceid": "cdd1885c-f639-4e8d-985b-54fadc471b36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:37:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-33d90a06-d5c4-4ed9-ab6d-0e2fa8cd8c65 req-0aca276d-c6c9-4ab2-abeb-0be491ce43ae service nova] Releasing lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:37:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "5b065f50-7389-4000-967a-b30802c5c4c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:37:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "5b065f50-7389-4000-967a-b30802c5c4c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:37:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:37:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:37:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:37:14 user nova-compute[71312]: INFO nova.compute.manager [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Terminating instance
Jul 25 10:37:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:37:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Instance destroyed successfully.
Jul 25 10:37:15 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lazy-loading 'resources' on Instance uuid 5b065f50-7389-4000-967a-b30802c5c4c8 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:35:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-500043683',display_name='tempest-TestVolumeBootPattern-server-500043683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-500043683',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ58gOY1gpOMvj/EiDsxdOjUfY11OGPSuA+GqxT7AzdzB8RcuiyhMOzL2fb60k7qwq0j7GQDzCRx0/Eh2wLjaML4Hb7FzYQTNf3zkUR2LuJI3IlnbZbMees+kYGZ2MIH6Q==',key_name='tempest-TestVolumeBootPattern-1416605656',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:35:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-98bknw2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:35:34Z,user_data=None,user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=5b065f50-7389-4000-967a-b30802c5c4c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdd1885c-f639-4e8d-985b-54fadc471b36", "address": "fa:16:3e:d1:e9:da", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd1885c-f6", "ovs_interfaceid": "cdd1885c-f639-4e8d-985b-54fadc471b36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "cdd1885c-f639-4e8d-985b-54fadc471b36", "address": "fa:16:3e:d1:e9:da", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd1885c-f6", "ovs_interfaceid": "cdd1885c-f639-4e8d-985b-54fadc471b36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:e9:da,bridge_name='br-int',has_traffic_filtering=True,id=cdd1885c-f639-4e8d-985b-54fadc471b36,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd1885c-f6') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_vif [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:e9:da,bridge_name='br-int',has_traffic_filtering=True,id=cdd1885c-f639-4e8d-985b-54fadc471b36,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd1885c-f6') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdd1885c-f6, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:37:15 user nova-compute[71312]: INFO os_vif [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:e9:da,bridge_name='br-int',has_traffic_filtering=True,id=cdd1885c-f639-4e8d-985b-54fadc471b36,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd1885c-f6')
Jul 25 10:37:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LctYwZsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:37:15 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4642ccf-47a9-4acb-8749-a77f2c7aaf22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:37:15 user nova-compute[71312]: No targets found.
Jul 25 10:37:15 user nova-compute[71312]: iSNS:
Jul 25 10:37:15 user nova-compute[71312]: No targets found.
Jul 25 10:37:15 user nova-compute[71312]: STATIC:
Jul 25 10:37:15 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571
Jul 25 10:37:15 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:37:15 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:37:15 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee
Jul 25 10:37:15 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:37:15 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:37:15 user nova-compute[71312]: FIRMWARE:
Jul 25 10:37:15 user nova-compute[71312]: No targets found.
Jul 25 10:37:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:37:15 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:37:15 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dc1806-00ad-4622-b0fd-71d5cfb55608]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdc2566-a660-433d-aabc-47b9e211da23]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:37:15 user nova-compute[71312]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee (non-flash)
Jul 25 10:37:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:37:15 user nova-compute[71312]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee (non-flash)
Jul 25 10:37:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9c0164e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60f36b0-477e-4030-ab01-eccd92fff58c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[89651eea-a7f0-40a9-ad38-ac56ea607adc]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec919c8-3847-4c2c-8790-78753463eb73]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7dcf8e-cb6e-4410-aac6-6eadd4936787]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23236663763653334', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_79e892ce', '/dev/disk/by-id/scsi-1SCST_BIO79e892ce-26f7ce3407e8991b') {{(pid=82549) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[086e9b58-665b-4949-b6aa-5cc6ec025cb7]: (4, None) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Received event network-changed-cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Refreshing instance network info cache due to event network-changed-cdd1885c-f639-4e8d-985b-54fadc471b36. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] Acquiring lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] Acquired lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG nova.network.neutron [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Refreshing network info cache for port cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[629ee31c-5557-4ada-a5ce-f14c4dbb90c7]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[63efb8af-0ee9-4cf8-ba92-02cc2b9247f5]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee, portal: 172.16.0.220,3260]
Jul 25 10:37:15 user nova-compute[71312]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee, portal: 172.16.0.220,3260] successful.
Jul 25 10:37:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f19bde-91e6-4e69-9f91-e7361c4efeee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38096e4-3589-4c8b-9772-b4fc3ace7b1d]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== disconnect_volume: return (459ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:37:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Deleting instance files /opt/stack/data/nova/instances/5b065f50-7389-4000-967a-b30802c5c4c8_del
Jul 25 10:37:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Deletion of /opt/stack/data/nova/instances/5b065f50-7389-4000-967a-b30802c5c4c8_del complete
Jul 25 10:37:15 user nova-compute[71312]: INFO nova.compute.manager [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Took 1.36 seconds to destroy the instance on the hypervisor.
Jul 25 10:37:15 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:37:15 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:37:16 user nova-compute[71312]: DEBUG nova.network.neutron [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Updated VIF entry in instance network info cache for port cdd1885c-f639-4e8d-985b-54fadc471b36. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:37:16 user nova-compute[71312]: DEBUG nova.network.neutron [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Updating instance_info_cache with network_info: [{"id": "cdd1885c-f639-4e8d-985b-54fadc471b36", "address": "fa:16:3e:d1:e9:da", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd1885c-f6", "ovs_interfaceid": "cdd1885c-f639-4e8d-985b-54fadc471b36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:37:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] Releasing lock "refresh_cache-5b065f50-7389-4000-967a-b30802c5c4c8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:37:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Received event network-vif-unplugged-cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:37:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] Acquiring lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:37:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] Lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:37:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] Lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:37:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] No waiting events found dispatching network-vif-unplugged-cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:37:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Received event network-vif-unplugged-cdd1885c-f639-4e8d-985b-54fadc471b36 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:37:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Received event network-vif-plugged-cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:37:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] Acquiring lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:37:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] Lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:37:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] Lock "5b065f50-7389-4000-967a-b30802c5c4c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:37:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] No waiting events found dispatching network-vif-plugged-cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:37:16 user nova-compute[71312]: WARNING nova.compute.manager [req-c65177fa-2c7d-46c2-ac17-e972accdb393 req-5a6f93c3-0ddb-48b7-90bc-b3e8f4586b26 service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Received unexpected event network-vif-plugged-cdd1885c-f639-4e8d-985b-54fadc471b36 for instance with vm_state active and task_state deleting.
Jul 25 10:37:16 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:37:16 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Took 0.51 seconds to deallocate network for instance.
Jul 25 10:37:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-2fdebaa5-d175-48ee-92ea-c4e97821e561 req-84afa9e8-b83d-46cb-9443-8672d790ac7f service nova] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Received event network-vif-deleted-cdd1885c-f639-4e8d-985b-54fadc471b36 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:37:17 user nova-compute[71312]: INFO nova.compute.manager [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Took 0.72 seconds to detach 1 volumes for instance.
Jul 25 10:37:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:37:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:37:17 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:37:17 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:37:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:37:17 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Deleted allocations for instance 5b065f50-7389-4000-967a-b30802c5c4c8
Jul 25 10:37:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c59421c-abca-40fd-a9cd-07f91e9891ff tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "5b065f50-7389-4000-967a-b30802c5c4c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.913s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:37:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_power_states {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:37:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 46d26d26-23b4-4a9c-ae16-63dda292a3ed {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:37:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Triggering sync for uuid 000f4177-aa96-4868-84e2-9e39520bc9e7 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 10:37:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:37:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:37:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "000f4177-aa96-4868-84e2-9e39520bc9e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:37:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:37:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:37:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:37:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:30 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690281435.2817786, 5b065f50-7389-4000-967a-b30802c5c4c8 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:37:30 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] VM Stopped (Lifecycle Event)
Jul 25 10:37:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6fc5a443-92f5-4dc0-9bd8-4f32bcbe4720 None None] [instance: 5b065f50-7389-4000-967a-b30802c5c4c8] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:37:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:37:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:37:38 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:37:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:37:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 10:37:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:37:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:37:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:37:39 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lazy-loading 'info_cache' on Instance uuid 46d26d26-23b4-4a9c-ae16-63dda292a3ed {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:37:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Updating instance_info_cache with network_info: [{"id": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "address": "fa:16:3e:23:71:c9", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75337dc7-36", "ovs_interfaceid": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:37:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:37:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:37:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:37:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:37:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:37:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:37:48 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:37:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:37:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:37:52 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:37:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:37:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:37:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:37:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:37:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:37:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:37:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:37:56 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:37:57 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:37:57 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:37:57 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8667MB free_disk=25.148780822753906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 46d26d26-23b4-4a9c-ae16-63dda292a3ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Instance 000f4177-aa96-4868-84e2-9e39520bc9e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:37:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:38:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:38:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:38:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:38:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:38:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:38:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:38:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-f7a2b523-67fc-4bc9-81a1-1a26c668c835 req-febf971c-48e7-4958-b753-1849810b2259 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Received event network-changed-75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-f7a2b523-67fc-4bc9-81a1-1a26c668c835 req-febf971c-48e7-4958-b753-1849810b2259 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Refreshing instance network info cache due to event network-changed-75337dc7-36f2-44d5-b3c0-5b749dda87a4. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f7a2b523-67fc-4bc9-81a1-1a26c668c835 req-febf971c-48e7-4958-b753-1849810b2259 service nova] Acquiring lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f7a2b523-67fc-4bc9-81a1-1a26c668c835 req-febf971c-48e7-4958-b753-1849810b2259 service nova] Acquired lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG nova.network.neutron [req-f7a2b523-67fc-4bc9-81a1-1a26c668c835 req-febf971c-48e7-4958-b753-1849810b2259 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Refreshing network info cache for port 75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:38:14 user nova-compute[71312]: INFO nova.compute.manager [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Terminating instance
Jul 25 10:38:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-67f2b36c-0fbf-4d1c-b6c0-4907c5ffc3a6 req-cffbfb5f-3030-488d-a1ed-da304d6fc182 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Received event network-vif-unplugged-75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-67f2b36c-0fbf-4d1c-b6c0-4907c5ffc3a6 req-cffbfb5f-3030-488d-a1ed-da304d6fc182 service nova] Acquiring lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-67f2b36c-0fbf-4d1c-b6c0-4907c5ffc3a6 req-cffbfb5f-3030-488d-a1ed-da304d6fc182 service nova] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-67f2b36c-0fbf-4d1c-b6c0-4907c5ffc3a6 req-cffbfb5f-3030-488d-a1ed-da304d6fc182 service nova] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-67f2b36c-0fbf-4d1c-b6c0-4907c5ffc3a6 req-cffbfb5f-3030-488d-a1ed-da304d6fc182 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] No waiting events found dispatching network-vif-unplugged-75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-67f2b36c-0fbf-4d1c-b6c0-4907c5ffc3a6 req-cffbfb5f-3030-488d-a1ed-da304d6fc182 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Received event network-vif-unplugged-75337dc7-36f2-44d5-b3c0-5b749dda87a4 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG nova.network.neutron [req-f7a2b523-67fc-4bc9-81a1-1a26c668c835 req-febf971c-48e7-4958-b753-1849810b2259 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Updated VIF entry in instance network info cache for port 75337dc7-36f2-44d5-b3c0-5b749dda87a4. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG nova.network.neutron [req-f7a2b523-67fc-4bc9-81a1-1a26c668c835 req-febf971c-48e7-4958-b753-1849810b2259 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Updating instance_info_cache with network_info: [{"id": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "address": "fa:16:3e:23:71:c9", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75337dc7-36", "ovs_interfaceid": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:38:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f7a2b523-67fc-4bc9-81a1-1a26c668c835 req-febf971c-48e7-4958-b753-1849810b2259 service nova] Releasing lock "refresh_cache-46d26d26-23b4-4a9c-ae16-63dda292a3ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:38:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Instance destroyed successfully.
Jul 25 10:38:15 user nova-compute[71312]: DEBUG nova.objects.instance [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lazy-loading 'resources' on Instance uuid 46d26d26-23b4-4a9c-ae16-63dda292a3ed {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:33:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-221199288',display_name='tempest-TestVolumeBootPattern-server-221199288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-221199288',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ58gOY1gpOMvj/EiDsxdOjUfY11OGPSuA+GqxT7AzdzB8RcuiyhMOzL2fb60k7qwq0j7GQDzCRx0/Eh2wLjaML4Hb7FzYQTNf3zkUR2LuJI3IlnbZbMees+kYGZ2MIH6Q==',key_name='tempest-TestVolumeBootPattern-1416605656',keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e55fc0544c744824b3b999ecfcf11e31',ramdisk_id='',reservation_id='r-5w2w6xix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-614700428',owner_user_name='tempest-TestVolumeBootPattern-614700428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:33:31Z,user_data=None,user_id='b15229b8fb22457ca38b9c5bf2f6dbc3',uuid=46d26d26-23b4-4a9c-ae16-63dda292a3ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "address": "fa:16:3e:23:71:c9", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75337dc7-36", "ovs_interfaceid": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converting VIF {"id": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "address": "fa:16:3e:23:71:c9", "network": {"id": "68a0c1f3-26b4-4df9-8f4a-c3fe394aff68", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-374378084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55fc0544c744824b3b999ecfcf11e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75337dc7-36", "ovs_interfaceid": "75337dc7-36f2-44d5-b3c0-5b749dda87a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:71:c9,bridge_name='br-int',has_traffic_filtering=True,id=75337dc7-36f2-44d5-b3c0-5b749dda87a4,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75337dc7-36') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_vif [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:71:c9,bridge_name='br-int',has_traffic_filtering=True,id=75337dc7-36f2-44d5-b3c0-5b749dda87a4,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75337dc7-36') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75337dc7-36, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:38:15 user nova-compute[71312]: INFO os_vif [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:71:c9,bridge_name='br-int',has_traffic_filtering=True,id=75337dc7-36f2-44d5-b3c0-5b749dda87a4,network=Network(68a0c1f3-26b4-4df9-8f4a-c3fe394aff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75337dc7-36')
Jul 25 10:38:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa9c0284f70>, {'target_iqn': 'iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aABoFvsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 10:38:15 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08a7eae-8834-4140-b71b-fbe6d7cf58d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 10:38:15 user nova-compute[71312]: No targets found.
Jul 25 10:38:15 user nova-compute[71312]: iSNS:
Jul 25 10:38:15 user nova-compute[71312]: No targets found.
Jul 25 10:38:15 user nova-compute[71312]: STATIC:
Jul 25 10:38:15 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571
Jul 25 10:38:15 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Jul 25 10:38:15 user nova-compute[71312]:                 Iface Name: default
Jul 25 10:38:15 user nova-compute[71312]: FIRMWARE:
Jul 25 10:38:15 user nova-compute[71312]: No targets found.
Jul 25 10:38:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 10:38:15 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 10:38:15 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a260027d-4754-4abe-8fc9-d13333f6e747]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4535710d-15c9-41b7-b53c-a35457fab38e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:38:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 (non-flash)
Jul 25 10:38:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa9a8631090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7a1790-2e74-4690-a263-019dec287e5a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[879d5e11-b605-4467-8a25-127125d46111]: (4, ('ok\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4ef765-6df8-427a-984f-600a522f0d69]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2603ab3-beb9-4759-9636-8533c0a5a481]: (4, ('1', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_1f4d6467', '/dev/disk/by-id/scsi-23933363565363265', '/dev/disk/by-id/scsi-1SCST_BIO1f4d6467-9365e62e9f9fc665') {{(pid=82549) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0424fd89-1c62-41fc-9256-13d9cdbcddc3]: (4, None) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cd8cf1-2c02-49a5-9c9f-2973b1d0692f]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --logout {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ba48d0-9a08-451c-bd07-3c088fa58cf6]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260]
Jul 25 10:38:15 user nova-compute[71312]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571, portal: 172.16.0.220,3260] successful.
Jul 25 10:38:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op delete {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061f586d-f94e-4713-9a9c-874aaabcd571 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82549) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e746de5-1e4b-4412-ba90-994623a8d1c8]: (4, ('', '')) {{(pid=82549) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] <== disconnect_volume: return (304ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 10:38:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Deleting instance files /opt/stack/data/nova/instances/46d26d26-23b4-4a9c-ae16-63dda292a3ed_del
Jul 25 10:38:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Deletion of /opt/stack/data/nova/instances/46d26d26-23b4-4a9c-ae16-63dda292a3ed_del complete
Jul 25 10:38:15 user nova-compute[71312]: INFO nova.compute.manager [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 25 10:38:15 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:38:15 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:38:15 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Took 0.45 seconds to deallocate network for instance.
Jul 25 10:38:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-45fb8576-734c-4f17-8ca9-5b62f9cbecc8 req-b5ac3a75-387e-448d-9b10-9b69df2a0397 service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Received event network-vif-deleted-75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:38:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-e022075d-b646-4498-9e0a-d3bea5bbee81 req-5b28bc55-5d76-4845-9885-57ad9661165b service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Received event network-vif-plugged-75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:38:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e022075d-b646-4498-9e0a-d3bea5bbee81 req-5b28bc55-5d76-4845-9885-57ad9661165b service nova] Acquiring lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:38:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e022075d-b646-4498-9e0a-d3bea5bbee81 req-5b28bc55-5d76-4845-9885-57ad9661165b service nova] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:38:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e022075d-b646-4498-9e0a-d3bea5bbee81 req-5b28bc55-5d76-4845-9885-57ad9661165b service nova] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:38:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-e022075d-b646-4498-9e0a-d3bea5bbee81 req-5b28bc55-5d76-4845-9885-57ad9661165b service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] No waiting events found dispatching network-vif-plugged-75337dc7-36f2-44d5-b3c0-5b749dda87a4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:38:16 user nova-compute[71312]: WARNING nova.compute.manager [req-e022075d-b646-4498-9e0a-d3bea5bbee81 req-5b28bc55-5d76-4845-9885-57ad9661165b service nova] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Received unexpected event network-vif-plugged-75337dc7-36f2-44d5-b3c0-5b749dda87a4 for instance with vm_state active and task_state deleting.
Jul 25 10:38:16 user nova-compute[71312]: INFO nova.compute.manager [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Took 0.73 seconds to detach 1 volumes for instance.
Jul 25 10:38:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:38:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:38:16 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:38:16 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:38:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:38:16 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Deleted allocations for instance 46d26d26-23b4-4a9c-ae16-63dda292a3ed
Jul 25 10:38:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-14e48e0e-e68a-4ed6-af62-9723481b0e7f tempest-TestVolumeBootPattern-614700428 tempest-TestVolumeBootPattern-614700428-project-member] Lock "46d26d26-23b4-4a9c-ae16-63dda292a3ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.689s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:38:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:30 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690281495.1346006, 46d26d26-23b4-4a9c-ae16-63dda292a3ed => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:38:30 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] VM Stopped (Lifecycle Event)
Jul 25 10:38:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ccc8a42f-4f85-4174-9f1e-516277b5098b None None] [instance: 46d26d26-23b4-4a9c-ae16-63dda292a3ed] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:38:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:38:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:38:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:38:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:38:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:38:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:38:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:38:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:38:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "refresh_cache-000f4177-aa96-4868-84e2-9e39520bc9e7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 10:38:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquired lock "refresh_cache-000f4177-aa96-4868-84e2-9e39520bc9e7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 10:38:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 10:38:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Updating instance_info_cache with network_info: [{"id": "377b85e7-2bc7-43cc-9971-b739d962135c", "address": "fa:16:3e:7f:f6:35", "network": {"id": "db79f9f9-66e6-4b16-9508-545925384510", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2072222984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4505d39249a44a88e618bd3d909d74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377b85e7-2b", "ovs_interfaceid": "377b85e7-2bc7-43cc-9971-b739d962135c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:38:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Releasing lock "refresh_cache-000f4177-aa96-4868-84e2-9e39520bc9e7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 10:38:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Acquiring lock "000f4177-aa96-4868-84e2-9e39520bc9e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Acquiring lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:38:42 user nova-compute[71312]: INFO nova.compute.manager [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Terminating instance
Jul 25 10:38:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-7fffb760-f5b8-4ddc-a800-d2fa9cb7e247 req-ee4e558e-08c2-4edd-bfdc-e7037fe499d8 service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Received event network-vif-unplugged-377b85e7-2bc7-43cc-9971-b739d962135c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7fffb760-f5b8-4ddc-a800-d2fa9cb7e247 req-ee4e558e-08c2-4edd-bfdc-e7037fe499d8 service nova] Acquiring lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7fffb760-f5b8-4ddc-a800-d2fa9cb7e247 req-ee4e558e-08c2-4edd-bfdc-e7037fe499d8 service nova] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7fffb760-f5b8-4ddc-a800-d2fa9cb7e247 req-ee4e558e-08c2-4edd-bfdc-e7037fe499d8 service nova] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-7fffb760-f5b8-4ddc-a800-d2fa9cb7e247 req-ee4e558e-08c2-4edd-bfdc-e7037fe499d8 service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] No waiting events found dispatching network-vif-unplugged-377b85e7-2bc7-43cc-9971-b739d962135c {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-7fffb760-f5b8-4ddc-a800-d2fa9cb7e247 req-ee4e558e-08c2-4edd-bfdc-e7037fe499d8 service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Received event network-vif-unplugged-377b85e7-2bc7-43cc-9971-b739d962135c for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:38:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:38:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Instance destroyed successfully.
Jul 25 10:38:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lazy-loading 'resources' on Instance uuid 000f4177-aa96-4868-84e2-9e39520bc9e7 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 10:38:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T10:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-399673293',display_name='tempest-VolumesActionsTest-instance-399673293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-399673293',id=51,image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T10:36:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4505d39249a44a88e618bd3d909d74b',ramdisk_id='',reservation_id='r-6d056gpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae3fdcb7-b1e3-4aa0-befc-4b580fff3ad8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1385404890',owner_user_name='tempest-VolumesActionsTest-1385404890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T10:36:51Z,user_data=None,user_id='196ca753f75448f3a0a17e06f09819f4',uuid=000f4177-aa96-4868-84e2-9e39520bc9e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "377b85e7-2bc7-43cc-9971-b739d962135c", "address": "fa:16:3e:7f:f6:35", "network": {"id": "db79f9f9-66e6-4b16-9508-545925384510", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2072222984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4505d39249a44a88e618bd3d909d74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377b85e7-2b", "ovs_interfaceid": "377b85e7-2bc7-43cc-9971-b739d962135c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 10:38:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Converting VIF {"id": "377b85e7-2bc7-43cc-9971-b739d962135c", "address": "fa:16:3e:7f:f6:35", "network": {"id": "db79f9f9-66e6-4b16-9508-545925384510", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2072222984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4505d39249a44a88e618bd3d909d74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377b85e7-2b", "ovs_interfaceid": "377b85e7-2bc7-43cc-9971-b739d962135c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 10:38:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:f6:35,bridge_name='br-int',has_traffic_filtering=True,id=377b85e7-2bc7-43cc-9971-b739d962135c,network=Network(db79f9f9-66e6-4b16-9508-545925384510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377b85e7-2b') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 10:38:43 user nova-compute[71312]: DEBUG os_vif [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:f6:35,bridge_name='br-int',has_traffic_filtering=True,id=377b85e7-2bc7-43cc-9971-b739d962135c,network=Network(db79f9f9-66e6-4b16-9508-545925384510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377b85e7-2b') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 10:38:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap377b85e7-2b, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 10:38:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:38:43 user nova-compute[71312]: INFO os_vif [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:f6:35,bridge_name='br-int',has_traffic_filtering=True,id=377b85e7-2bc7-43cc-9971-b739d962135c,network=Network(db79f9f9-66e6-4b16-9508-545925384510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377b85e7-2b')
Jul 25 10:38:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Deleting instance files /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7_del
Jul 25 10:38:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Deletion of /opt/stack/data/nova/instances/000f4177-aa96-4868-84e2-9e39520bc9e7_del complete
Jul 25 10:38:43 user nova-compute[71312]: INFO nova.compute.manager [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 25 10:38:43 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 10:38:43 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 10:38:43 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 10:38:44 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 10:38:44 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Took 0.76 seconds to deallocate network for instance.
Jul 25 10:38:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-5df3c0b2-b918-4faa-b528-3de7ee257a14 req-b95624f4-fcd6-43ff-acb3-40565f0f166a service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Received event network-vif-deleted-377b85e7-2bc7-43cc-9971-b739d962135c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:38:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:38:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:38:44 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:38:44 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:38:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:38:44 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Deleted allocations for instance 000f4177-aa96-4868-84e2-9e39520bc9e7
Jul 25 10:38:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-20ecc8ce-7d21-47db-b0c8-bfc726ce4ecd tempest-VolumesActionsTest-1385404890 tempest-VolumesActionsTest-1385404890-project-member] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.998s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:38:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-4213f374-be32-4881-b3df-feb63a3f6c5e req-d317a503-d15a-4d36-9554-e279454f16f4 service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Received event network-vif-plugged-377b85e7-2bc7-43cc-9971-b739d962135c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 10:38:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4213f374-be32-4881-b3df-feb63a3f6c5e req-d317a503-d15a-4d36-9554-e279454f16f4 service nova] Acquiring lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:38:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4213f374-be32-4881-b3df-feb63a3f6c5e req-d317a503-d15a-4d36-9554-e279454f16f4 service nova] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:38:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4213f374-be32-4881-b3df-feb63a3f6c5e req-d317a503-d15a-4d36-9554-e279454f16f4 service nova] Lock "000f4177-aa96-4868-84e2-9e39520bc9e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:38:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-4213f374-be32-4881-b3df-feb63a3f6c5e req-d317a503-d15a-4d36-9554-e279454f16f4 service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] No waiting events found dispatching network-vif-plugged-377b85e7-2bc7-43cc-9971-b739d962135c {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 10:38:44 user nova-compute[71312]: WARNING nova.compute.manager [req-4213f374-be32-4881-b3df-feb63a3f6c5e req-d317a503-d15a-4d36-9554-e279454f16f4 service nova] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Received unexpected event network-vif-plugged-377b85e7-2bc7-43cc-9971-b739d962135c for instance with vm_state deleted and task_state None.
Jul 25 10:38:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:38:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:38:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:38:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:38:55 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:38:55 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:38:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:38:58 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690281523.3371944, 000f4177-aa96-4868-84e2-9e39520bc9e7 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 10:38:58 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] VM Stopped (Lifecycle Event)
Jul 25 10:38:58 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8584d24c-68cc-4995-a74a-5a4f87464b36 None None] [instance: 000f4177-aa96-4868-84e2-9e39520bc9e7] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 10:38:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:38:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:38:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:38:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:38:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:38:58 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:38:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:38:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:38:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:38:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:38:59 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:38:59 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:38:59 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8898MB free_disk=25.175399780273438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:38:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:38:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:38:59 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:38:59 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:38:59 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:38:59 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:38:59 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:38:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:39:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:39:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:39:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:39:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:39:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:39:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:39:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:39:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:39:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:39:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:39:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:39:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:39:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:39:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:39:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:39:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:39:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:39:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:39:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:39:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 10:39:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 10:39:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:39:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:39:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:39:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:39:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:39:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:39:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:39:55 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:39:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:39:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:39:58 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:40:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:40:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:40:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:40:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:40:00 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:40:01 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:40:01 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:40:01 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=25.173381805419922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:40:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:40:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:40:01 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:40:01 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:40:01 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:40:01 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:40:01 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:40:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:40:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:40:03 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:40:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4995-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:40:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:40:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:40:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:40:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:40:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:40:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:40:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:40:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:40:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:40:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:40:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 10:40:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 10:40:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 10:40:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:40:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:40:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 10:40:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:40:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:40:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:40:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:40:55 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:40:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:40:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:40:58 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:40:58 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:41:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:41:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 10:41:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:41:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:41:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:41:02 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 10:41:03 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:41:03 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 10:41:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=25.17084503173828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 10:41:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 10:41:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 10:41:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 10:41:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 10:41:03 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed in ProviderTree for provider: c43d9a23-2919-4969-9b66-f1d29eb9e809 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 10:41:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:41:03 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Inventory has not changed for provider c43d9a23-2919-4969-9b66-f1d29eb9e809 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 10:41:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 10:41:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b00f349a-e56e-4dd1-9442-75eaa78cc45d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 10:41:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:41:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:41:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:41:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:41:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 10:41:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:41:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:41:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 10:41:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 10:41:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 10:41:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}